What is a automated test framework?

The word, "Framework" is a very broad and general term and, to be honest, I often find it a bit vague. The word itself doesn't get people very excited most of the time. I have felt, however, that if they knew what it could do for them, they would definitely be excited. 

Let's talk about how this applies to automated hardware testing systems. An automated test framework or ATF, is a software foundation that provides the necessary structure for creating the application software for automated test systems. A good framework helps test engineers create better, more consistent software that other test engineers will be able to understand and modify later. A bad framework might just get those same test engineers into trouble both while they are creating the system and later when they are attempting to maintain the system. 

A framework really works similarly to the blueprints and prefab materials that a house might use. The blueprint tells you where to put everything and the prefab components are useful to avoid figuring out things that have already been figured out. In other words, a good framework prevents you from reinventing the wheel all the time. All of this makes things more efficient and easier to fix when things go wrong. 

How do you identify a good framework? First, a good framework has fans. Find the fans if you can. Some industries, like aerospace, make finding fans difficult but they are out there. Second, look to see what it actually does for you.  In the case of automated hardware testing systems, one question is what is the code base that it was created in? Can it be used with other programming languages such as Python or C#?  Does it have a hardware abstraction layer that has a lot of instruments and how hard is it to add additional instruments? 

To illustrate the value of an automated testing framework, three test engineers from a large medical device manufacturer recently had the challenge to test multiple ultrasound probes on a single bench. After working on it for two years, they were not finding much success. Then, they found something that changed it all. In just two months, they were able to complete the system software and test the first probe. They were then able to add one probe each week for the next 50 weeks. What made the difference? It was an automated test framework. With the right framework, you can go from zero to hero. 

PS - We have that framework so let us know if you want to check it out.