Page History

Objectives:

• Improve the Pilot EQRS Program Dashboard to understand the challenges and opportunities for rolling out program dashboards across the enterprise
• Understand ISG Contractor Onboarding team's support needs and develop a support plan
• Support the ongoing adoption and understanding of Team Dashboards 

Value Delivered:

• We have improved the EQRS Program Dashboards by presenting the same development workflow for all teams, allowing comparison and enabling roll-up of data to the program level
• We have gained an understanding ISG Contractor Onboarding team's support needs. To help them achieve their primary goal of creating space for innovation, the LACE will facilitate Visioning Sessions, Value stream mapping sessions, support in instilling an environment of trust, and a LACE training program specific, to their programs needs 
• We continue to support the ongoing adoption and understanding of Team Dashboards through training and hands on clinics by offering trainings, clinics, and presenting the same development workflow for all teams. This enables enterprise to evaluate uniform data across teams and enabling roll-up of data to the program level

Objectives:

• Improve the accuracy and readability of the team dashboards by including an updated cumulative flow and a more accurate Average time to realized value
• Provide an overview of Center of Excellence(LACE/HCD) benefits, ongoing, and future initiatives to help CCSQ Center Leadership understand how to leverage the COE's to for improving the enterprise
• Increase the topical coverage in the LACE Training Library to support the ongoing growth of Agile program leadership from within CMS
• Improve the value and accuracy of the EQRS Pilot and upcoming Program dashboard by aligning data and measurements to enterprise standards and time boundaries within the business intelligence tool.

Value Delivered:

• We have improved the  accuracy and readability of the team dashboards by including an updated cumulative flow, presenting enterprise standard process steps and increasing the data accuracy
• We have gained an understanding of how to leverage the business intelligence tools to normalize the presentation of Jira data to provide comparable data across teams and programs
• We continue to support the enterprise in growth and development of practices and behaviors through training and helping center leadership understand how we can support their goals

8 points abandoned (

3 points unplanned (

Objectives:

• Provide a coaching plan to help Qimvig move towards business agility and gain alignment with product development teams
• Increase the topical coverage in the LACE Training Library to support the ongoing growth of Agile program leadership from within CMS
• Improve the Program dashboard by providing PI time boundaries 

Value Delivered:

• Defined a coaching plan and success measures to help QimVig support the move towards enterprise business agility 
• Increased the topical coverage and training quality of the LACE Training Library to support the ongoing growth of Agile program leadership from within CM by updating the OKR Training Presentation
• Provided the ability to track progress and growth opportunities by providing insights based on program PI Boundaries this was added to the EQRS Pilot Program dashboard but will be implemented on the existing Enterprise Dashboards

8 points added

5 points removed

Objectives:

• Responding to support request from multiple programs based on the programs individual needs
• Support the enterprise in growth of practices and behaviors through the development and delivery of training to help center leadership run agile programs effectively.  
• Responding to support requests and increasing accuracy of dashboards to help the enterprise track progress and identify growth opportunities

Value Delivered:

• Increased LACE training offerings by developing the 2 hour Inspect & Adapt Explained course. Learners will receive an in-depth review of the I&A and experience a mock problem-solving workshop.
• Fulfilled and maintained engagement with multiple program and LACE support requests
  • Onboarding Team Coaching Support: a continuous improvement roadmap structured in OKR format is suggested to the team.
• Fostered the elevation practices and behaviors through the development and delivery of training to help center leadership run agile programs effectively.  
  • Development of a new Inspect and Adapt Explained Training
  • Delivery of DevOps Explained Training
  • Facilitated WSJF Clinic
  • Created the Q2 training calendar for review with our CMS Product Owner before publishing
•  Advanced Program Metrics Dashboard by enabling users to filter by PI and see PI by PI trends

Objectives:

• Responding to support request from multiple programs based on the programs individual needs
  
  • Onboarding Team
  • QMVIG Coaching support 
  • QPP RTE Support
• Support the enterprise in growth of practices and behaviors through the development and delivery of training to help center leadership run agile programs effectively.  
  • Development of Kanban Explained 
  • Delivery of PI Planning Explained
  • Delivery of CSSQ Dashboards Explained
  • LACE User Story Clinic
  • Dashboard Metrics Clinic
  • New Confluence Course Catalog Pages
• Responding to support requests and increasing accuracy of dashboards to help the enterprise track progress and identify growth opportunities
  
  • Integrating Historical, Trend, and current state reports into a single dashboard

Value Delivered:

• We have updated the training content to the latest know-how in the industry in order to increased customer experience and satisfaction - for the 2 training courses: Business Agility and Kanban
• We have discussed the roadmap/plan for the Onboarding Team Continuous Improvement Journey, collected individual feedback, and clarified the role of the LACE Coach

Objectives:

• Continue to make program dashboard improvements 
• Increase the quality of training content to the latest industry know-how to keep learners up-to-date on behaviors and practices
• Responding to upcoming PI Planning with conversations, identification of potential logistics tools space and coordination for both Center of Excellence(LACE/HCD)
• Responding to support request from QMVIG program based on the program need
• Continue the development of agility maturity for CCSQ by delivering LACE courses per our course delivery plan
• Prepare second quarter LACE and SAFe course offerings
• Prepare transition e-mail for LACE with the community
• Prepare registration e-mails for both LACE and SAFe courses for registrants

Value Delivered:

• We have successfully confirmed joint PI-Planning for LACE/HCD for April 5th and 6th. Placeholder invite has been scheduled in Agilecoaches Calendar. LACE/HCD meetings have been scheduled to collaborate 1-2 times per week to continue to work on logistics and PI-planning readiness. 
• LACE Facilitated WSJF clinic on 3/17 and provided a walkthrough on Weighted Shorter Job First techniques and calculations on economic view and value delivery. https://qnetconfluence.cms.gov/pages/viewpage.action?pageId=259013293
• We have successfully prepared a transition e-mail to create awareness for the community.
• We have created communication that sets the expectation for registrants for LACE and SAFe courses

5 points removed

Objectives:

• Support the enterprise in growth of practices and behaviors through the development and delivery of training to help center leadership run agile programs effectively.  
  • Delivery of Business Agility Explained
  • Delivery of Kanban Explained
• Responding to upcoming PI Planning Readiness : Responding to upcoming PI Planning with conversations, identification of potential logistics tools space and coordination for both Center of Excellence(LACE/HCD)
• Improveaccuracy withinDashboards reports

Value Delivered:

• We have successfully created a space in confluence for LACE/HCD PI Planning readiness. The space has access to Program Board, Objectives, Event preparation, Agenda, Inspect and Adapt, and Roadmap forecasting for this upcoming PI and future program increment LACE/HCD PI- Planning Readiness
• LACE added confluence space to view completed features, candidate features, and Epics LACE/HCD PI-Planning Increment (1) this is reflected from our LACE Program Kanban Board. 
• Implemented fixes and improvements to the Delivery Predictability and Planning Variance reports that improve the usability of both Enterprise and Portfolio dashboards.

2 points unplanned (

Objectives:

• Program engagement
  • Present discoveries QMVIG with front office & divisions within QMVIG. Sharing observations on what has been discovered and the plan to implement
  • Present, discuss, and create alignment with customer on the strategy to evaluate the problem to solve for iQies initiative
  • Meeting with CMS lead to discuss and understand existing QIO contract to identify if there will be any engagement for HCD or LACE . (intake process)
• Courses:
  • LACE explained: OKR
  • LACE explained: Program Backlog Management
  • User Story Clinic
  • WSJF Clinic

• Dashboard improvements
  
  • additional report added to the program dashboard -historical delivery of work by type

• Internal processes
  • Training templates Color palettes 

Value Delivered:

• We have successfully identified the requirements and needs in order to develop workflow for QMVIG support team that will bring transparency and value that has been defined and captured. 
• LACE has worked closely with HCD and followed the Memorandum of Understanding (MOU) for both Centers of Excellence. Jointed efforts have been conducted to align with engagement strategy for IQIES HCD team, as well as documentation storage with discoveries ,and timeline defined.
• LACE/HCD met with Danita Patel, Adam Heller and others to discuss engagement efforts for QIO. At this point the efforts will be only focus on HCD research of systems for QIO Contract, understanding DARTT System, users and how to improve them.
• LACE delivered two short courses covering the Objectives and Key Results, Program Backlog Management, and provided the community with a clinic to improve User Story authoring
• The Program Dashboard was updated to include insights into how much feature, enabler and technical debt was delivered in past and current PIs
• The Team pulled deeper historical data into the existing dashboards to address leadership request for more insight into the impact that CCSQ LACE has provided the enterprise.

(Some planned work was removed from the iteration to accommodate a CCSQ leadership request for information)

Objectives:

• Program engagement
  • QMVIG team ongoing coaching efforts to focus on Team working agreements to ensure the support team members understands and agree. 
  • IQIES HCD coaching engagement with CMS-HCD point of contact to analyze Jira Boards and metrics to identify anti-patterns and document results of analysis. As well as addressing DoR, DoD and Team level working agreements are examined. 
• Courses:
  • LACE explained: Roadmap
  • User Story Clinic
  • OKR Clinic
• Dashboard Support Request
  
  • Jira Projects added to CCSQ Enterprise Metrics Dashboard (AiOps: AI/ML Scrum Team, AiOps: Operations and Support Scrum Board, AiOps: Software Engineering Scrum Board)
• Internal processes
  • Training templates Color palettes 
  • Standard Operation Procedure (SOP) for course content development. 
• SAFe for Government Day Conference (2022) LACE will attend to bring some information about best practices within the government space to CCSQ

Value Delivered:

• We have successfully delivered LACE explained Roadmap training with 11 attendees (4) Feds and (7) contractors.
• AiOps Dashboard support request completed. Data source imported for (3) teams: (AiOps: AI/ML Scrum Team, AiOps: Operations and Support Scrum Board, AiOps: Software Engineering Scrum Board). CCSQ LACE Team Dashboard now shows these respective teams and their metrics are helping them to become more mature with agile practices.
• LACE attended SAFe DAY Government 2022 conference.
• iQIES HCD coaching support by analyzing Jira Boards and metrics and a document has been created and stored with the results of the analysis: https://qnetconfluence.cms.gov/pages/viewpage.action?pageId=273355026

• QMVIG Coaching engagement ongoing support efforts to leadership and teams. LACE had (2) sessions of Backlog prioritization with the program and will be working on building Team Working agreements on the week of 4/25.

• Met with Brandy Barnette for LACE continue Feature Refinement decomposition of work and priorities.

2 points abandoned

( LACE-2790 

( LACE-2778

Backlog

10 pts:

(LACE-2648

(LACE-1443

(LACE-2842

(LACE-2836

Objectives:

• Internal processes
  • Training templates Color palettes 
• Courses:
  • SAFe POPM
• Program engagement

• • QMVIG team ongoing coaching efforts to focus on backlog refinement to generate a healthy backlog and prioritization. 
  • IQIES Sharing observations from PI Planning and Jira analysis with CMS leadership. Be in coordination for next steps.

• Dashboard improvements
  
  • Updating the program wide backlog composition report to show backlog state at the beginning of a PI

Value Delivered:

• Finalized the Master Training PowerPoint template enabling the team to easily develop PowerPoint training decks with standard layouts and switch between seven different color palettes.
• LACE Facilitated SAFe Product Owner/ Product Manager certified training to the CCSQ community with (12) attendees. 
• LACE will be offering Study Hall Sessions for those that attended SAFe POPM over the next few weeks to provide participant assistance in preparation for exam certification
• Enabler work was conducted on data collection from LACE Training register for fed vs. contractor and Pivot Table created with queries to narrow participant's attendance from Eventbrite. 
• Dashboard Support inquiry follow-up for End User Computing and Access Team https://qnetjira.cms.gov/browse/LACE-2706 
• Program engagement support for iQIES HCD team. LACE examined and assessed the current stage of team social contracts: (Team working agreements/ Definition of Ready/ Definition of Done). Documentation stored here: Team Social Contract Analysis
• Feature Refinement Session with Brandy Barnette and scope identified for Program Dashboard
• LACE had a demo with EQRS program leads and RTE on Program Dashboards Pilot. 
• iQIES: progress towards the completion of the discovery phase is shared with CMS leadership. Potential risks with the HCD team restructuring are discussed.
  
• QMVIG had multiple refinement sessions which has created a healthy backlog. Task have also been assigned to the team.

Backlog

6 pts:

(LACE-2684

(LACE- 2842

Objectives:

• Courses:
  • LACE Explained: Social Contracts
  • WSJF Clinic
  • SAFe POPM Study Hall
• Program engagement
  • IQIES
  • An overview of some Agile Ceremonies with QMVIG division leads to help adopt a Kanban process
• Dashboards
  
  • Updating the program wide backlog composition report to show backlog state at the beginning of a PI
• SOP
  • Continue documentation of Course Development SOP to enable the team to use the new Master Training PowerPoint deck.
• ROI
  • Establish a calculation method that captures ROI for LACE
• LACE attendance
  • Develop list of attendees per course Fed vs. Contractors for courses

Value Delivered:

• Facilitated and Encouraged participants while being a part of a great discussion around social contracts and why they are important. (Social Contracts)
• Provided resources to attendees on how to utilize WSJF (WSJF Clinic) https://qnetconfluence.cms.gov/display/LACE/Toolkit Weighted Shortest Job First (Feature Calculator) 
• LACE provided SAFe Program Owner/ Program Manager Study Hall session to get attendees prepared for SAFe exam
• Dashboard Enhancements: 4 different measures were created for EQRS PI's. A dashboard for testing was also implemented 
• LACE created Set-up Session in confluence as the team continues to invest in Standard Operating Procedures with efforts to document "Course Development" to enable the team to use Master PowerPoint Deck. https://qnetconfluence.cms.gov/display/LACE/Course+Content+Development+SOPs
• Developed Definition of "Return on Investment" ROI and Value on Investment "VOI" using Gartner's Research Model. https://qnetconfluence.cms.gov/pages/viewpage.action?pageId=279156131
• Created an Excel "Calculator" to develop a formula to capture ROI, services, and Training data from Registrants vs Surveys responses for all "LACE Explained Courses" 
• LACE Iteration Reviewed conducted with Brandy and collected feedback from stories presented
• The Team met with EQRS Leadership to discuss EQRS Pilot Dashboards and define the next steps: LACE will continue to work with RTE on program labels and structure
• Feature Refinement session with Brandy to continue to identify the scope and decompose Feature work 
• iQies: The team structure of the HCD team is changing (offboarding & onboarding of ADO team members). Alignment between CMS leadership and CoE around the current state of the discovery and agreement on the next steps
• QMVIG Definition of Done has been established and captured. All QMVIG support team members understand and agree on the DOD.

Backlog

5 pts:

(LACE-2681

(LACE-3145

Objectives:

• Courses:
  • LACE Explained: PI Planning
  • LACE Explained: Backlog Prioritization
  • OKR Clinic
  • User Story Clinic
  • SAFe POPM Study Hall
• Program engagement
  
  • QMVIG
• Dashboards
  
  • Updating the program wide backlog composition report to show backlog state at the beginning of a PI
• Course attendance Dashboard

Value Delivered:

• Successful delivery of the LACE explained Backlog Prioritization course with (4) out (7) expected attendees
• Successful delivery of the LACE explained PI Planning with (13) registered for the course
• LACE offered the CCSQ Community with Objective and Key Result Clinic. https://qnetconfluence.cms.gov/display/LACE/LACE+Clinics
• Facilitated and provided a space for User Story Clinic. Where participant refined and revised User Story Writing techniques and Acceptance criteria updated here: https://qnetconfluence.cms.gov/display/LACE/User+Story+Clinic%3A+May+12%2C+2022
• LACE provided SAFe Program Owner/ Program Manager Study Hall session to get attendees prepared for SAFe exam (2 out of 2) Sessions
• IQies coaching engagement preparation by developing checklist templates for Agile Ceremonies in prep of observation and recommendations on best practice techniques for forming teams: https://qnetconfluence.cms.gov/display/LACE/HCD_iQies+-+Scrum+Ceremonies+Checklist
  • Developed DSU checklist document
  • Developed Refinement checklist document 
  • Developed Sprint Planning checklist document 
  • Developed Sprint Review/ Demo checklist document 
• QMVIG coaching support by presenting an overview of Agile ceremonies for DQM 
• Developed Federal Attendance Dashboard Federal Attendance Dashboard that allows easy comparison of federal attendees to total attendees from data timeframe (September 9th, 2021 to April 12, 2022)
• LACE held Feature Refinement Session with Brandy to continue to prioritize and decompose scope of work and any scope changes in priorities.
• Conducted Iteration Review Demo with Brandy Barnette and incorporated feedback loop into our backlog items 
• Attended HCD Refinement Session and discussed dependencies on LACE/HCD Joint Training and Article Newsletter Initial Draft. 
• LACE Attended HIDS meeting in regards to proposed hierarchical planning framework that uses Jira (Portfolio Epics, Program Epics, Features) for ADO's and shared CCSQ Agile Playbook Recommendations: https://qnetconfluence.cms.gov/display/LACE/Work+Structure

Backlog

5 pts:

(LACE-3168

Objectives:

• Courses:
  • LACE Explained: Estimating Work
  • LACE Explained: Inspect & Adapt
  • WSJF Clinic
• Program engagement
  
  • QMVIG
  • IQIES - observing Observing scrum ceremonies (Iteration Planning & Review)
• Dashboards
  
  • Features started report accurately 
• Course attendance Dashboard
  • Display graphs
• CoE 101

Value Delivered:

• <Add info here>

Objectives:

• <Add info here>

Value Delivered:

• <Add info here>

Objectives:

• <Add info here>

Value Delivered:

• <Add info here>

Objectives:

• <Add info here>

Value Delivered:

• <Add info here>

Objectives:

• <Add info here>

Value Delivered:

• <Add info here>

Objectives:

• <Add info here>

Value Delivered:

• <Add info here>