Sustainment of legacy automatic test systems: lessons learned on TPS transportability

Sustainment of legacy automatic test systems (ATS) saves cost through the re-use of software and hardware. The ATS consists of the automatic test equipment (ATE), the test program sets (TPSs), and associated software. The associated software includes the architecture the TPSs run on, known as the control software or test station test executive. In some cases, to sustain the legacy ATS, it is more practical to develop a replacement ATE with the latest instrumentation, often in the form of commercial off-the-shelf (COTS) hardware and software. The existing TPSs, including their hardware and test programs, then need to be transported, or translated, to the new test station. In order to understand how to sustain a legacy ATS by translating TPSs, one must realize the full architecture of the legacy ATS to be replaced. It must be understood that TPS transportability does not only include translating the original TPS from an existing language (such as ATLAS) to a new language (such as "C") to run on a new test station, but includes transporting the run-time environment created by the legacy ATS. This paper examines the similarities and differences of legacy ATE and modern COTS ATE architectures, how the ATS testing philosophy impacts the ease of TPS transportability from legacy ATE to modern-day platforms, and what SEI has done to address the issues that arise out of TPS transportability.     

COTS software design minimizes ATS lifecycle cost

This paper identifies the design features of commercial-off-the-shelf (COTS) software that impact the lifecycle cost of automatic test system (ATS) solutions and provides a set of design guidelines. It demonstrates that the architecture of COTS software must be modular, based on correct functional allocation, should possess distribution capabilities, and contain open interfaces that remain backwards compatible. In the case of COTS development tools, the programmatic interface should be simple, extensible, and enforced in the development environment.     

Bridging the gap between ATLAS and C: an open-systems approach toTPS re-host

As the DoD focuses on commercialization and open-architecture standards, the need to migrate existing TPSs from proprietary ATLAS-based platforms to an Open Systems platform becomes more critical. This paper will focus on a solution which leverages COTS software tools and emerging industry standards and technologies to implement object-oriented database tools which enable the conversion of an ATLAS TPS to an ANSI C environment     

Integrating system engineering software tools

System engineering projects typically involve the use of a variety of design, analysis, simulation, and management software tools that are home-grown or commercial-off-the-shelf (COTS). Very often, these applications are hosted on dissimilar computing platforms in a network environment. An application deployed on one platform may not be easily ported to another platform, and it usually cannot be readily accessed by software on the other platform. Enhancing the inter-operation among software applications or tools will greatly increase the effectiveness of the system engineering process. The middleware technology currently being developed by the computer industry promises to provide the needed software interface for integrating tools across a heterogeneous computer network. This paper discusses the experience of applying the middleware technology to software tools used in system engineering     

Open systems architecture solutions for military avionics testing

Raytheon makes extensive use of open systems architecture methods in developing special test equipment (STE) for testing military avionics equipment. Such use has resulted in significant cost and schedule savings in the development of production test equipment for radar and infrared systems. With open systems architectures, a test system can be assembled using COTS products. This brings economies of scale to test equipment, which is normally built in very low quantities. Therefore, the potential cost savings due to COTS usage is proportionately greater in STE than in the higher volume avionics systems that are tested. A second major benefit of using COTS products is that test system development schedule cycle time is greatly reduced. This paper describes the application of Open Systems Architectures (OSA) to avionics testing. The following major architectures are surveyed: VME bus, VXI bus, IEEE GPIB, IEEE 1149.1 JTAG test bus, 1553 Military Bus, Fibre Channel, and COTS Test Applications Software. We describe how the benefits of OSA have been extended at Raytheon into achieving vertical test commonalities. The flexibility of OSA can be exploited to provide an overall optimum test solution, taking all levels of test into account. For example, test systems can be tailored with COTS products to provide integrated methods for avionics tests at the module, unit, and system levels. Test systems can be configured to maximize the reuse of COTS hardware over all test levels. Test software can also be programmed to optimize such reuse over levels of test. Additional test verticality synergies derived from such OSA usage are described, including: test false alarm avoidance; test cones of tolerance optimization; and efficient test of field returns     

Replacement strategy for aging avionics computers

With decreasing defense dollars available to purchase new military aircraft, the inventory of existing aircraft will have to last many more years than originally anticipated. As the avionics computers on these aging aircraft get older, they become more expensive to maintain due to parts obsolescence. In addition, expanding missions and changing requirements lead to growth in the embedded software which, in turn, requires additional processing and memory capacity. Both factors, parts obsolescence and new processing capacity, result in the need to replace the old computer hardware with newer, more capable microprocessor technology. New microprocessors, however, are not compatible with the older computer instruction set architectures. This generally requires the embedded software in these computers to be rewritten. A significant savings-estimated in the billions of dollars-could be achieved in these upgrades if the new computers could execute the old embedded code along with any new code to be added. This paper describes a commercial-off-the-shelf (COTS)-based form, fit, function, and interface (F³I) replacement strategy for legacy avionics computers that can reuse existing avionics code “as is” while providing a flexible framework for incremental upgrades and managed change. It is based on a real-time embedded software technology that executes legacy binary code on the latest generation COTS microprocessors. This technology promises performance improvements of 5-10 times that of the legacy avionics computer that it replaces. It also promises a 4× decrease in cost and schedule over rewriting the code and provides a “known good” starting point for incremental upgrades of the embedded flight software. Code revalidation cost and risk are minimized since the structure of the embedded code is not changed, allowing the replacement computer to be retested at the “blackbox” level using existing qualification tests     

Use of service history for certification credit for COTS [avionic software]

Much has been written in the last ten years about how the use of commercial-off-the-shelf (COTS) components would revolutionize the aerospace industry avionics, communication, navigation, surveillance/air traffic management (CNS/ATM) as well as global air traffic management (GATM). Civil aviation authorities around the world have been faced with numerous requests to certify aircraft containing increasing percentages of COTS components, much of it never designed or intended for use in the safety critical environment of an aircraft. Product service history is one method for demonstrating that such software is acceptable for use. In theory, product service history would seem to be a fairly simple concept, both to understand and to apply. However, in practice, such use has proven extremely problematic, as questions of how to measure the historic performance and the relevance of the provided data have surfaced. This paper elaborates a research effort funded by the United States Federal Aviation Administration to collect, analyze, and synthesize what is known and understood about applying product service history. The effort is limited to the topic of software product service history as applied in the certification of airborne systems and equipment.     

基于COTS的航空电子软件开发

介绍了商用货架产品(COTS)在航空电子软件开发中应用的优点和缺点,和基于COTS的航电软件构架;并给出了一个开发过程和部分开发工具。最后通过一个实例说明基于COTS的航电软件开发是实际可行的。     

Vertical test integration

Today, most every weapon system is electronics intensive. Digital computers are at the core of military aircraft, ship, and vehicle weapons systems. Indeed, each weapon system's performance is largely determined by its digital computers and other electronics. This electronics dependency is necessary in order to provide the speed, functional compliance, and accuracy to achieve the required weapon system performance. Historically, test systems required for the various maintenance levels and also at the manufacturing site have each been uniquely developed, employed, and sustained for only one area of weapon system electronics support. There are a number of reasons for this situation including different organizations responsible for the levels of support, different funding sources, timing limitations, and technical feasibility. In recent years, however, commercial-off-the-shelf (COTS) advances in measurement and stimulation hardware, personal computers, Windows operating systems, flexible test programming languages, and more, have made it technically feasible to develop a family of test systems that provide common weapon system electronics support at all levels. Some use the phrase Vertical Test Integration to describe this concept of factory/field/depot integration     

面向复用的航天测控软件测试用例建模研究

首先阐述了测试复用的基本原理,在对航天测控软件测试可复用资源和复用层次进行分析的基础上,利用现有测试资源,提出了基于用例包的测试用例可复用结构改造技术、基于行业领域主题词的检索技术和测试用例的复用策略,给出了对应的测试用例复用模型,实现了用例有效复用及管理。按该模型构建的航天测控软件测试用例复用库系统对提高测试效率和测试质量具有一定的借鉴意义。     

IMA aircraft improvements

Integrated modular avionics (IMA) is being suggested as the means by which new capabilities can be deployed on aircraft at an affordable cost. RTCA SC-200 is presently considering the guidance document for IMA. All of the functionality that IMA offers can be achieved through a conventional federated architecture; however, the cost, size, and weight penalties of the federated solution make it economically infeasible. IMA is seen as the way forward. It is assuming greater importance as the aircraft industry transitions to commercial-off-the-shelf (COTS) technology with its attendant obsolescence and reliability concerns. IMA may be one of the most cost-effective ways by which rapid obsolescence can be managed. Ironically, this move to COTS is also the greatest threat to IMA systems. IMA achieves reductions in size, cost, and weight by providing a set of flexible hardware and software resources that can be statically or dynamically mapped to a set of required avionics functional capabilities. This introduces a number of new complexities such as mixed criticalities and reconfiguration. We do not address these issues herein. Rather we discuss the mechanisms by which electronics degrades and how a classical safety assessment of a reconfigurable IMA system can be ified by this degradation. We argue that, with the advent of COTS, it is no longer justifiable to consider that electronics has an effectively constant failure rate. Physical considerations suggest that electronics failure occurs when environmental and operating stress causes the accumulation of damage to the underlying structures to exceed the threshold strength of the constituent materials and interfaces. Finally, we suggest how finite-life electronics effects may be mitigated.     

Derating Concerns for Microprocessors Used in Safety-Critical Applications

The use of commercial-off-the-shelf (COTS) microprocessors for safety-critical applications usually implies derating of the device to make it work in harsh environments. We discuss derating concerns for state-of-the-art microprocessors. Issues addressed herein include noise margins due to low voltage levels, multiple power supplies, frequency and current derating concerns, error sources, timing degradation, power-aware architectures, and new advanced microprocessor derating features.     

The cost of COTS

Fairchild Defense, a division of Orbital Sciences Corporation, has been a pioneer in the use of Commercial-Off-The-Shelf (COTS) hardware, software, and tools in military equipment. Fairchild has developed a cost and schedule effective approach to the use of COTS elements. This paper discusses Fairchild's experience with the use of COTS in military equipment and special considerations imposed because of the military environment     

Reconfigurable COTS test systems

Automatic Test Equipment (ATE) systems are used to qualify, accept, and troubleshoot electronic products. ATE systems may be in the form of large general-purpose systems that can test a wide variety of products or the more commonly used custom, turnkey systems that are designed for specific test application(s) and requirements. Turnkey ATE systems are labor-intensive; as a result, even a relatively simple turnkey tester is costly and may take months (or even years) to develop, integrate, and deploy. The main reason for this aspect of turnkey ATE systems is that even though the instrumentation may be off-the-shelf components, most everything else is custom and requires design, development, extensive debug and integration. Time and again, systems integrators have tried to find a solution that would combine the cost effectiveness of COTS systems with the flexibility of custom ATE. This paper suggests a solution to this problem and that it is feasible to combine COTS testers with custom requirements. This solution, called CreATE, provides a flexible architecture using COTS components (including instruments, cabling and interfacing products)     

基于HLA的航天飞行任务联合仿真系统设计

简要说明了HLA的基本特点,描述了一个已经实现的航天测控仿真系统,并将其结构思想与HLA进行了对照。在此基础上,提出了一个依据HLA标准,对航天员座舱仿真、火箭和飞船仿真、测控网仿真等进行集成的航天飞行任务联合仿真系统框架,分析了各个仿真联邦成员的功能需求和信息接口,并着重介绍了针对任务要求的时间管理、数据通信等关键RTI机制的设计和实现方法,以及参照FEDEP模型和借助商业成品软件工具的系统开发策略。     

一种任务规划地面站软件自动化测试框架设计

任务规划地面站软件是保障飞机安全飞行的重要软件,为解决该类软件测试时采用传统自动化测试工具测试脚本维护困难、复用率低,手工测试效率低下等问题,本文设计并提出了一种自动化测试框架。框架基于关键字驱动的思想,通过建立控件映射表,定义常用测试关键字,自动生成测试文档等设计,实现了测试用例与测试脚本的分离,使测试用例的设计、维护、复用更加灵活、简便,并能有效提高软件测试效率。     

建立与硬件无关通用测试程序的方法

IVI 驱动技术是当今受人推崇的软件控制新技术。文中阐述了 IVI 技术的应用,真正实现了仪器的可互换性.使得工程人员的测试程序可以应用于不同的仪器设备。文中介绍了 IVI驱动机制、使用工具、建立虚拟仪器等方面的相关问题。     

Anti-aircraft artillery simulator

Air defense systems protect land and maritime resources from air attack. Depending on the regional characteristics and type of conflicting forces, air defense threats vary considerably. In regional conflicts, where forces with similar capabilities are involved and no air-superiority can be achieved, the role of air defense systems becomes critical. In combat terrains containing mountains (in mainland or in small islands), the man-operated or computer-controlled (using passive sensors) anti-aircraft artillery can be highly effective. The simulator presented in this work aims to exploit the capabilities provided by current commercial-off-the-shelf (COTS) communication and multimedia technologies for providing a training environment that improves the personnel capability for effective use of man-controlled anti-aircraft weapons.     

Low-cost technology for multimode radar

A flexible test bed radar architecture is described which includes an integrated RF electronics package that can support multiple radar applications, including surveillance, fire control, target acquisition, and tracking. This type of architecture can significantly reduce the cost, power, size, and weight of electronics on future weapon delivery platforms. The Army Research Laboratory (ARL) is developing technology to support multimode radar requirements. These requirements include the detection and location of moving or stationary low radar cross section targets in heavy ground clutter and the classification and/or recognition of these targets. We address these requirements with commercial-off-the-shelf (COTS) products and the integration of several enabling technologies. The test bed radar includes a direct digital synthesizer (DDS) for frequency-diverse waveform generation, a flexible wideband transceiver for bandwidth extension and frequency translation, and an open architecture signal processor with embedded wideband analog-to-digital converters for real-time acquisition and processing. Efficient signal processing algorithms have been developed to demonstrate multimode radar capability. This paper discusses the various subassemblies, algorithm efficiency, and field experiment results