top of page

Metric Driven Verification

Historically it is seen that many companies drive verification tasks based on count of project test cases, indicating to be the signoff criteria. However; this method has been and is still used in majority  of projects by  many companies. This industry pain, due to the effort and time spent on verification is just growing day by day  as system complexity and re-use of test cases continues to grow rapidly.

​

Nevertheless; the growing complexity and high number of test cases demands for higher use of resources to debug and to run regression. Longer and longer time is spent on debugging and high level of CPU/server resources is used for regression runs due to huge number of tests and due to long simulation times. The importance of reducing  time to market, has already shown to be key differentiator between  success or failure . Hence , it is time to reduce re-use of legacy test cases  and demonstrate that critical functions have been covered and made visible  when planning the verification effort of the project. . Further it is time to re-configure the way  resources are allocated in order to  meet the milestones.

​

Our focus is to reduce time spent on verification by applying metrics on verification efforts, to enhance the quality, to reduce the risk and to control and minimize  time to market. Up front planning  of verification  provides what we seek.

Project Management and KPI based reporting

Over time we have learned that projects miss milestones due to long regressions runs and due to failing tests. The debugging time has never been longer than it is today. Project managers have no control or insight to when  exactly tasks are done and when ready to sign off..

​

Lack of test case and RTL insight at management level provides a huge gap between management and the engineers. It is important to spend the resources on risk items rather than low priority items, identifying and ranking issues in the right order, is key factor to manage ressources, but how do you do that while only having X count of test cases?.

​

Industry studies performed by leading players, concludes from historical and present verification efforts to have grown from 30% till today 47% of total project resources and with a clear trend to continue to increase.

​​

Our focus is to manage the verification effort correctly upfront for better resource allocation based on regression and debugging progress. We aim to secure that resources create values for the project and the development is according to the plan. We want to implement KPI’s that will secure project plans with our agile process.

Management Controlled Flow

Poorly managed  test case driven verification plans and lack of insight  provides a huge gap between management, architects/ designers and verifiers  A long list of test cases and low -level test case insight  does not provide deep enough  knowledge to validate function coverage, providing biased and ineffective risk management. ​

​

We target to  give control back to  management by providing regression and verification insight. We want to deliver best in class verification flow and control. By connecting  single low-level checkpoint all the way up to a level where it will be visible. By looking at our regression reports, management will be provided sufficient information to lead resources and make efficient project decisions.

bottom of page