How do developers or test engineers identify suitable test cases? They use the graphic classification tree editor CTE XL Professional1) for the systematic specification and implementation of test cases. And how do they execute these test cases on real hardware without instrumentation? By generating the test cases in CTE XL Professional, importing them into the iSYSTEM test tool testIDEA2) and executing them.
Today, iSYSTEM, a company located in Schwabhausen (near Munich), and Berner & Mattner (based in Munich) are presenting an integration of their software test tools.
With this cooperation, iSYSTEM and Berner & Mattner respond to the demand for consistent development tools and automated test tools required especially by the automotive industry. Nowadays, many companies use a "line-up of tools" in the various development stages of a so-called "embedded system". There are no smooth transitions and automatisms between the individual stages and the respective tools. Consequently, the know-how achieved at the beginning of the process often goes missing, and numerous steps have to be repeated over and over again. There is a higher demand for software testing particularly at the early stages of the development process, calling for techniques and automatisms for the systematic generation of test cases and their execution in a real environment, in other words, on the target hardware.
Up to now, the two partners have covered different stages of the development and test process. iSYSTEM focuses on software development for the implementation/integration of software and hardware, especially software testing at the development engineer's workplace; Berner & Mattner specializes in systems engineering, development and testing of high-performance electronic and mechanical systems and, in this context, especially consulting, conceptual design, software and system development, setup and operation of entire test and integration systems.
"The combination of CTE XL Professional and testIDEA facilitates the systematic and rule-based development of the test structures generated in the iSYSTEM test tool environment. New and modified test cases can thus be generated and transferred back automatically to testIDEA, iSYSTEM's test execution tool. This saves a lot of time and enhances test coverage substantially," says iSYSTEM's CEO Erol Simsek.
"The integration of CTE XL Professional and testIDEA is the perfect basis for combining black box and white box tests. Many users have been asking for simple test execution techniques for the test cases they have identified, and we satisfy their wish by integrating these two powerful tools. Everyone who establishes test cases carefully and systematically wants to benefit from direct test case execution," explains Dr. Joachim Wegener, Head of Departments at Berner & Mattner.
Both companies will continue their cooperation and further extend the integration of their tools over the next months.
Background Information:
Classification Tree Editor CTE XL Professional - Graphical Editor for Classification Trees
The classification tree method was developed in the 1990s, followed by the classification tree editor. The editor is context-sensitive and a powerful tool for the systematic specification and implementation of test cases. CTE XL Professional is not related to a specific domain and thus equally suitable for both system development and software engineering.
Applications range from system requirements analysis to automated test case implementation. Higher-quality test case specifications are generated in shorter time. Main features are the intuitive classification tree method, automated test case generation as well as open interfaces to numerous tools.
CTE XL Professional features extensive functions, like test case prioritization, enhanced coupling to tools like IBM Rational DOORS, HP QualityCenter and MESSINA, as well as extensive support of requirements tracing. Berner & Mattner offers professional support in this context.
CTE XL Professional - Benefit:
- Reduced test effort through consistent and domain-independent use in all test phases
- Well-arranged systematic test specifications
- Cost reduction through automated test case generation
- Measurable evaluation of test coverage
- Integrated with many state-of-the-art tools
- Easy to learn; minimum training effort
- Extensive requirements tracing support
iSYSTEM testIDEA - Software Test Tool without Program Code Instrumentation
Software testing plays an important role in modern development processes. The keyword in this context is revised functional safety standards for a variety of markets. For this reason, iSYSTEM has added a so-called real-time unit test tool (testIDEA) to its range of products. It is part of the development environment winIDEA and facilitates the execution of test cases on the target system without program code instrumentation.
testIDEA is essentially a set of open and free programming interfaces (API) entirely integrated into the iSYSTEM development environment winIDEA. Using this set of APIs, engineers can write test applications/test cases and also execute them automatically on customer-specific hardware connected through iSYSTEM tools. Test applications, test cases and the related test reports can be written in many different programming and scripting languages (Python, Java, C/C++, C#, Perl, TCL, ...).
Moreover, testIDEA is an interactive editor for test case and test report generation and can be selected directly in winIDEA. This way, test cases can be set up without programming
know-how. testIDEA saves test cases as YAML files (YAML Ain't Markup Language4)), an XML-based syntax that is much easier to read and can be processed in other languages. For example, YAML files can be integrated into Python one-to-one and are thus available in executable format.
testIDEA is used directly at the development engineer's workplace, in his usual tool environment. This way, the engineer can run the so-called unit test (smallest piece of testable software) in his 'black box' (no function code review) and 'white box' variant (function code review, code coverage).
A major benefit of unit testing without code instrumentation is a short turn-around time, as the test is executed without an additional compile, link and download cycle. No test drivers are required, so no resources on the target system are used. Functions like tracing, profiling and code coverage can be integrated into the test runs, extending the range of the iSYSTEM test technology beyond unit testing into integration and system testing.
Further Information
1) http://www.cte-xl-professional.com/...
2) http://www.isystem.com/...
About Berner & Mattner
Berner & Mattner specializes in systems engineering, development and testing of complex electronic and mechanical systems. We offer a variety of services ranging from consulting, conceptual design, software and systems development to the setup and operation of entire test and integration systems. We are a strategic partner for our customers' development departments of the automotive, energy, defence, mechanical engineering, space and transportation industries, providing customized software and engineering solutions based on our products and services. In doing so, we optimize efficiency and quality of our customers' software and system development. This is why leading companies such as Audi, BMW, Bombardier, Daimler, Deutsche Bahn, Siemens and many more have been placing their trust in Berner & Mattner's expertise. The company with headquarters in Munich was founded in 1979, currently employs 430 people at 7 sites in Germany and Austria and is a member of the international Assystem Group. Further information on Berner & Mattner: www.berner-mattner.com.
Today, iSYSTEM, a company located in Schwabhausen (near Munich), and Berner & Mattner (based in Munich) are presenting an integration of their software test tools.
With this cooperation, iSYSTEM and Berner & Mattner respond to the demand for consistent development tools and automated test tools required especially by the automotive industry. Nowadays, many companies use a "line-up of tools" in the various development stages of a so-called "embedded system". There are no smooth transitions and automatisms between the individual stages and the respective tools. Consequently, the know-how achieved at the beginning of the process often goes missing, and numerous steps have to be repeated over and over again. There is a higher demand for software testing particularly at the early stages of the development process, calling for techniques and automatisms for the systematic generation of test cases and their execution in a real environment, in other words, on the target hardware.
Up to now, the two partners have covered different stages of the development and test process. iSYSTEM focuses on software development for the implementation/integration of software and hardware, especially software testing at the development engineer's workplace; Berner & Mattner specializes in systems engineering, development and testing of high-performance electronic and mechanical systems and, in this context, especially consulting, conceptual design, software and system development, setup and operation of entire test and integration systems.
"The combination of CTE XL Professional and testIDEA facilitates the systematic and rule-based development of the test structures generated in the iSYSTEM test tool environment. New and modified test cases can thus be generated and transferred back automatically to testIDEA, iSYSTEM's test execution tool. This saves a lot of time and enhances test coverage substantially," says iSYSTEM's CEO Erol Simsek.
"The integration of CTE XL Professional and testIDEA is the perfect basis for combining black box and white box tests. Many users have been asking for simple test execution techniques for the test cases they have identified, and we satisfy their wish by integrating these two powerful tools. Everyone who establishes test cases carefully and systematically wants to benefit from direct test case execution," explains Dr. Joachim Wegener, Head of Departments at Berner & Mattner.
Both companies will continue their cooperation and further extend the integration of their tools over the next months.
Background Information:
Classification Tree Editor CTE XL Professional - Graphical Editor for Classification Trees
The classification tree method was developed in the 1990s, followed by the classification tree editor. The editor is context-sensitive and a powerful tool for the systematic specification and implementation of test cases. CTE XL Professional is not related to a specific domain and thus equally suitable for both system development and software engineering.
Applications range from system requirements analysis to automated test case implementation. Higher-quality test case specifications are generated in shorter time. Main features are the intuitive classification tree method, automated test case generation as well as open interfaces to numerous tools.
CTE XL Professional features extensive functions, like test case prioritization, enhanced coupling to tools like IBM Rational DOORS, HP QualityCenter and MESSINA, as well as extensive support of requirements tracing. Berner & Mattner offers professional support in this context.
CTE XL Professional - Benefit:
- Reduced test effort through consistent and domain-independent use in all test phases
- Well-arranged systematic test specifications
- Cost reduction through automated test case generation
- Measurable evaluation of test coverage
- Integrated with many state-of-the-art tools
- Easy to learn; minimum training effort
- Extensive requirements tracing support
iSYSTEM testIDEA - Software Test Tool without Program Code Instrumentation
Software testing plays an important role in modern development processes. The keyword in this context is revised functional safety standards for a variety of markets. For this reason, iSYSTEM has added a so-called real-time unit test tool (testIDEA) to its range of products. It is part of the development environment winIDEA and facilitates the execution of test cases on the target system without program code instrumentation.
testIDEA is essentially a set of open and free programming interfaces (API) entirely integrated into the iSYSTEM development environment winIDEA. Using this set of APIs, engineers can write test applications/test cases and also execute them automatically on customer-specific hardware connected through iSYSTEM tools. Test applications, test cases and the related test reports can be written in many different programming and scripting languages (Python, Java, C/C++, C#, Perl, TCL, ...).
Moreover, testIDEA is an interactive editor for test case and test report generation and can be selected directly in winIDEA. This way, test cases can be set up without programming
know-how. testIDEA saves test cases as YAML files (YAML Ain't Markup Language4)), an XML-based syntax that is much easier to read and can be processed in other languages. For example, YAML files can be integrated into Python one-to-one and are thus available in executable format.
testIDEA is used directly at the development engineer's workplace, in his usual tool environment. This way, the engineer can run the so-called unit test (smallest piece of testable software) in his 'black box' (no function code review) and 'white box' variant (function code review, code coverage).
A major benefit of unit testing without code instrumentation is a short turn-around time, as the test is executed without an additional compile, link and download cycle. No test drivers are required, so no resources on the target system are used. Functions like tracing, profiling and code coverage can be integrated into the test runs, extending the range of the iSYSTEM test technology beyond unit testing into integration and system testing.
Further Information
1) http://www.cte-xl-professional.com/...
2) http://www.isystem.com/...
About Berner & Mattner
Berner & Mattner specializes in systems engineering, development and testing of complex electronic and mechanical systems. We offer a variety of services ranging from consulting, conceptual design, software and systems development to the setup and operation of entire test and integration systems. We are a strategic partner for our customers' development departments of the automotive, energy, defence, mechanical engineering, space and transportation industries, providing customized software and engineering solutions based on our products and services. In doing so, we optimize efficiency and quality of our customers' software and system development. This is why leading companies such as Audi, BMW, Bombardier, Daimler, Deutsche Bahn, Siemens and many more have been placing their trust in Berner & Mattner's expertise. The company with headquarters in Munich was founded in 1979, currently employs 430 people at 7 sites in Germany and Austria and is a member of the international Assystem Group. Further information on Berner & Mattner: www.berner-mattner.com.
