Load Tests

Solution Architect

• IoT / Embedded Computing
• .NET Communication Systems
• Web Technologies

Writer and consultant

• Microsoft MVP for C# / Development Tools
• Active contributions to open-source project s
• Articles for CodeProject, SitePoint, tuts+, ...

• 49% of online shoppers expect load times of <=2 seconds
• 50% of online shoppers abandon page if load time is > 2 seconds
• 42% of men and 35% of women won't come back after experiencing slow load times

Further Reading: latencytipoftheday.blogspot.de

• Status (idle, working, offline, ...)
• Throughput (# of requests)
• Max. queued requests
• Internal IO usage (disk, network)
• Processor usage
• Custom counters
• Load distribution

The Flaw of Averages: Why We Underestimate Risk in the Face of Uncertainty; Sam L. Savage, with illustrations by Jeff Danziger.

Always try to be deterministic!

Also it helps to have some kind of logging in order to validate any possible assumption.

• Arbitrary action
• Could be also just a timeout / idle

The load test needs to scale at least as good as the target.

We require flexibility even though agents need to run without supervision.

Targets may be on-promise, in the cloud, or mixed.

There is more than HTTP or RESTful APIs.

• AppDynamics
• New Relic
• Pulseway
• Dynatrace
• VS Load Test

Image by Dr. Alexander Wert and Dr. Christoph Heger, 2016.

"description": "My test description",
"resources": [{
	"provider": "azure",
	"options": {
		"authorization": { ... },
		"deployment": {
			"region": "West Europe",
			"storage": { ... },
			"cloudService": { ... },
			"serviceBus": { ... }
		}
	}
}],
"configurations": [ ... ]
			

"workers": 8192,
"threads": [{
	"type": "simulator",
	"setup": { ... },
	"execution": [
		"Delay({ time: `${workerId * 5}s` })",
		"GetTokenHash()",
		"RandomIdle({ min: '50ms', max: '1s' })",
		"GetToken()",
		"CheckForSoftwareUpdate()",
		"WaitForAll()"
		...
	]
}]
			

• Integrate load testing in the dev cycle
• Collect the right metrics
  • of the target
  • of the load test itself
• Be careful with result interpretation
• Use a load test solution that scales

• Feel free to contact me

• Web: florian-rappl.de
• eMail: mail@florian-rappl.de
• Twitter: @FlorianRappl
• GitHub: github.com/FlorianRappl

• Find the presentation at talks.florian-rappl.de/Dwx/LoadTests.