API architecture experimentation
A software company needed a public API able to serve 10x its existing request volume with p99 latency under 100 ms. The team was uncertain whether an event-driven design or a synchronous gateway with caching would meet the target.
Business component: Public API platform (software held for license)
Potentially qualifying factors
- Uncertainty about appropriate design to meet measurable performance targets
- Alternatives (event-driven vs. cached synchronous) evaluated through load testing
- Reliance on computer-science principles (concurrency, caching, queuing theory)
Potential exclusion issues
- Routine endpoint development using established patterns
- Work after the API was released to customers (post-commercial production)
- Documentation and developer-portal content
Documentation required
- Architecture decision records
- Load-test plans and results
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Database optimization
Queries on a multi-tenant database degraded as data grew. The team did not know whether partitioning, alternative indexing or a columnar store would restore performance without breaking consistency guarantees.
Business component: Data layer of a commercial SaaS product
Potentially qualifying factors
- Uncertainty about method and design
- Benchmarking of alternative schemas and indexes
- Iterative refinement based on measured results
Potential exclusion issues
- Applying a vendor's documented tuning guide without uncertainty
- Routine maintenance and monitoring
- Data migration after the design was settled
Documentation required
- Benchmark scripts and results
- Tickets linking experiments to findings
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Distributed system architecture
A team designing a multi-region replication system faced uncertainty about achieving consistency and failover targets under network partitions. They modeled three consensus approaches and ran fault-injection tests.
Business component: Replication subsystem
Potentially qualifying factors
- Modeling and simulation of alternatives
- Fault-injection experiments with recorded outcomes
- Design iterations driven by test results
Potential exclusion issues
- Deploying the chosen design to production
- Operations and on-call work
- Configuration of managed cloud services without experimentation
Documentation required
- Design documents comparing alternatives
- Fault-injection test logs
- Version-control history
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Performance optimization
A mobile application's rendering pipeline could not meet frame-rate targets on low-end devices. Engineers evaluated alternative rendering strategies with profiling.
Business component: Rendering engine
Potentially qualifying factors
- Measurable performance objective
- Systematic profiling and evaluation of alternatives
Potential exclusion issues
- Cosmetic UI changes
- Bug fixes after release unrelated to uncertainty
Documentation required
- Profiling data
- Benchmark comparisons
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Security architecture
A company designed a new key-management scheme for tenant data isolation and was uncertain whether it could meet latency constraints. It prototyped and tested two cryptographic designs.
Business component: Encryption and key-management component
Potentially qualifying factors
- Technical uncertainty on design and performance
- Prototype evaluation of alternatives
Potential exclusion issues
- Compliance audits and policy writing
- Routine penetration testing of a finished system
- Implementing a standard library as documented
Documentation required
- Threat models and design comparisons
- Performance test data
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Machine-learning experimentation
A team sought to build a model to predict equipment failure from sensor data. It did not know which features or architectures would achieve the required precision, and ran structured experiments across candidates.
Business component: Predictive-maintenance model (software)
Potentially qualifying factors
- Experiment tracking of model architectures and features
- Evaluation against defined metrics
Potential exclusion issues
- Routine data collection and labeling
- Model retraining in production on a fixed pipeline
- Market research on customer demand
Documentation required
- Experiment-tracking logs
- Evaluation reports
- Cloud GPU usage allocated to experiments
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Material testing
A manufacturer needed a lighter bracket that would survive cyclic loading. It tested three alloys and two heat treatments to failure.
Business component: Lightweight bracket (product)
Potentially qualifying factors
- Uncertainty about capability and design
- Destructive testing of alternatives
- Engineering analysis of failure modes
Potential exclusion issues
- Routine incoming material inspection
- Testing to confirm specification compliance for production lots
Documentation required
- Test protocols and results
- Material consumption records
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Process optimization
A plant sought to raise yield on a stamping line. Engineers evaluated die designs and press parameters in controlled trials.
Business component: Stamping process (plant process)
Potentially qualifying factors
- Process treated as separate business component
- Designed experiments with recorded parameters
Potential exclusion issues
- Routine adjustments by operators
- Efficiency studies without technical uncertainty
Documentation required
- Design-of-experiments plans
- Yield data
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Tolerance refinement
A precision component required tolerances tighter than the shop had achieved. Machinists and engineers trialed tooling paths, fixtures and thermal controls.
Business component: Precision shaft (product) and machining method (process)
Potentially qualifying factors
- Uncertainty about method to achieve tolerance
- Iterative trials with measurement data
Potential exclusion issues
- Routine first-article inspection
- Production runs after the method was established
Documentation required
- CMM measurement data by trial
- Fixture design iterations
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Tooling development
A manufacturer designed new injection-mold tooling for a part with complex geometry. The overall product was a known design, but the tooling's cooling layout was uncertain.
Business component: Mold tooling (shrinking back from the finished product)
Potentially qualifying factors
- Shrinking-back to the tooling subcomponent where uncertainty existed
- Mold-flow simulation of cooling alternatives
Potential exclusion issues
- Duplicating existing tooling
- Tooling that is depreciable property (not a supply QRE)
Documentation required
- Simulation files
- Tooling design revisions
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Load testing
An equipment maker redesigned a frame to carry higher loads and was uncertain which cross-section would meet fatigue targets. It combined FEA with physical load tests.
Business component: Equipment frame
Potentially qualifying factors
- Modeling plus physical testing
- Design changes driven by results
Potential exclusion issues
- Certification testing of a finished design
- Tests required by a customer contract that funds the work
Documentation required
- FEA models
- Load-test reports
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Prototype development
A company built functional prototypes of a new valve to determine whether a novel seal geometry would prevent leakage at high pressure.
Business component: High-pressure valve
Potentially qualifying factors
- Prototypes built to test uncertain designs
- Supplies consumed in prototypes
Potential exclusion issues
- Prototypes later sold to customers
- Pre-production pilot runs after design freeze
Documentation required
- Prototype build records
- Leak-test results
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Structural analysis
An engineering firm designing an unusual long-span roof could not determine from codes alone whether the proposed system would meet deflection limits. It modeled alternatives and iterated the design.
Business component: Roof structural system design
Potentially qualifying factors
- Uncertainty beyond code-prescribed solutions
- Iterative modeling of alternatives
Potential exclusion issues
- Routine code-compliance calculations
- Funded research if the client pays regardless of outcome and owns the results
Documentation required
- Model iterations
- Design memos
- Contract terms on risk and rights
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Design alternatives
A mechanical engineering team evaluated three cooling approaches for an electronics enclosure operating in extreme heat.
Business component: Enclosure thermal design
Potentially qualifying factors
- Evaluation of alternatives with thermal modeling and testing
Potential exclusion issues
- Selecting a standard catalogue solution without uncertainty
Documentation required
- CFD results
- Test data
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Simulation
A firm used computational fluid dynamics to evaluate alternative inlet geometries for an industrial fan to reduce noise while maintaining flow.
Business component: Fan inlet design
Potentially qualifying factors
- Simulation as a method of evaluating alternatives
Potential exclusion issues
- Simulations run only to document a known design
Documentation required
- Simulation inputs/outputs
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Performance testing
An engineering team tested a new pump control algorithm across operating conditions to determine whether it met efficiency targets.
Business component: Pump control system
Potentially qualifying factors
- Testing designed to resolve performance uncertainty
Potential exclusion issues
- Acceptance testing required after design completion
Documentation required
- Test matrices and results
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Formulation testing
A food manufacturer sought to reduce sodium by 30% while maintaining texture and microbial stability through processing. Food scientists trialed alternative salt replacers and processing parameters.
Business component: Reduced-sodium product formulation
Potentially qualifying factors
- Functional objectives (stability, texture under processing)
- Structured bench and pilot trials
Potential exclusion issues
- Taste-preference panels alone
- Seasonal flavor variants
- Packaging graphics
Documentation required
- Formulation trial records
- Lab analyses
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Shelf-life experimentation
A producer wanted to extend refrigerated shelf life from 21 to 45 days. It tested preservation methods and packaging atmospheres with microbial challenge studies.
Business component: Product formulation and packaging process
Potentially qualifying factors
- Measurable reliability/quality objective
- Challenge studies evaluating alternatives
Potential exclusion issues
- Routine shelf-life verification of an established product
- Regulatory labeling work
Documentation required
- Challenge-study protocols and results
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Process optimization
A bakery scaled a new product from pilot to production and faced uncertainty about mixing and baking parameters at scale.
Business component: Production process
Potentially qualifying factors
- Scale-up uncertainty resolved through trials
Potential exclusion issues
- Production after the process was validated (post-commercial production)
Documentation required
- Scale-up trial records
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Growing-condition experimentation
A grower tested irrigation schedules and substrate mixes to determine whether a crop variety could be grown profitably in a hotter climate zone.
Business component: Growing process for a crop variety
Potentially qualifying factors
- Controlled plots with recorded variables
- Reliance on agronomy and plant science
Potential exclusion issues
- Routine farming practices
- Weather-driven adjustments without experimental design
Documentation required
- Plot designs and yield data
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Crop and process optimization
A farm evaluated alternative post-harvest handling methods to reduce spoilage.
Business component: Post-harvest handling process
Potentially qualifying factors
- Evaluation of alternatives against defined loss targets
Potential exclusion issues
- Adopting established methods without uncertainty
Documentation required
- Spoilage measurements by method
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Equipment development
An agricultural business designed a custom harvester attachment for a crop with no commercial equipment available.
Business component: Harvester attachment
Potentially qualifying factors
- Prototype iterations
- Field testing
Potential exclusion issues
- Equipment costs (depreciable, not supplies)
- Routine repairs
Documentation required
- Design drawings and revisions
- Field test notes
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Prototype development
A device company developed a new catheter. The overall device used known elements, but the tip geometry needed to navigate tortuous vessels was uncertain.
Business component: Catheter (shrinking back to tip design)
Potentially qualifying factors
- Shrinking-back to the uncertain subcomponent
- Bench-top prototypes and simulated-use testing
Potential exclusion issues
- Regulatory submission preparation
- Clinical activities after design is final may raise post-production questions
Documentation required
- Design history file entries
- Test reports
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Testing
Engineers ran fatigue and biocompatibility screening on candidate designs to determine which met durability requirements.
Business component: Implantable device component
Potentially qualifying factors
- Testing of alternatives against uncertain requirements
Potential exclusion issues
- Routine lot-release testing
Documentation required
- Verification test protocols
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Materials
A company evaluated polymer blends for a flexible housing that needed to withstand repeated sterilization cycles.
Business component: Device housing material
Potentially qualifying factors
- Material trials with sterilization-cycle testing
- Supplies consumed in trials
Potential exclusion issues
- Selecting a material with known certified properties
Documentation required
- Material trial matrices
- Sterilization test data
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.
Mechanical design
Designers iterated a surgical instrument's actuation mechanism to reduce required hand force while maintaining precision.
Business component: Instrument actuation mechanism
Potentially qualifying factors
- Design iterations with force measurements
Potential exclusion issues
- Ergonomic styling changes
Documentation required
- CAD revisions
- Force test results
- Contemporaneous records of the uncertainty at the outset
- Records of alternatives evaluated and results
- Time allocation for personnel involved
Illustrative example. Qualification depends on the specific facts of each business component and is not automatic.