Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
excerpt-

Include Page

CollaborationCollaborationnopaneltrue
Panel
borderWidth0

CCSQ D&A HOME | Communications Calls | CCSQ Data & Analytics Data Camp | QNET Analytics Distro List

AnchorReturn to TopReturn to Top Excerpt IncludeRequesting & Getting Access

Data Nav_C
Data Nav_C


Requesting & Getting Accessnopaneltrue
Panel
borderWidth0

Livesearch
spaceKeyDATA
placeholderSearch CCSQ Data & Analytics site

CCSQ Data & Analytics Communications Call
DateFebruary 10, 2022
Recording

Agenda

  • General Announcements
  • System Updates
  • Data Source & Usage Updates
  • CCSQ Support Central Demo 
  • Q&A
General Announcements 
Slack Channel: Strength in Numbers - Community Driven Collaboration 
  • Last Communications Call, we introduced the CCSQ Data & Analytics Slack Channel, #ccsq_data_analytics!
  • This is a community-driven collaboration channel for creating connections with other members of the CCSQ Data and Analytics community, motivating each other and facilitating learning opportunities.
  • In this channel, you can submit your questions, respond to threads to contribute ideas, or share your best practices with others within the user community.
  • All users with SAS Viya Slack licenses have been added to our channel.
  • Please note that all announcements regarding CCSQ Data & Analytics will continue via email as some of our user community do not have access to Slack.
  • Please continue to post issues to the #help-service-center-sos Slack channel.
  • Please note that the D&A Team will not be monitoring this channel closely, as this channel is designed for users to collaborate with one another.
  • If you have questions about Slack access, reach out to your COR and the Contract Engagement Team.

Important Notes

  • When collaborating with other users, it is your responsibility to not share any PHI, PII, or sensitive information.
  • The success of this channel depends on you! We encourage you to ask questions and participate
CDR HDFS Migration 
  • Data & Analytics Team will start reaching out to CDR users to migrate legacy hive data sets from HDFS to S3 in phases
  • After migration, Data & Analytics Team will provide guidance and documentation on storing future data sets in S3 instead
  • Benefits:
    • Frees up disk space within CDR Cluster
    • S3 storage provides unlimited capacity, better persistence, and lifecycle capabilities
    • Supports future transformations of CDR Architecture to EMR
  • Dependency: Data & Analytics will depend on teams for coordination and validation of migrated data sets
System Updates
SAS Viya Issues
Lagging Issues
  • SAS Viya users have reported intermittent lagging and freezing while utilizing the application.
  • Due to the issue's intermittent nature, some users have reported that their issue has gone away by the time that a help desk ticket has been created.
  • In order to capture the details for the D&A Team to investigate, please follow these instructions found within the Known Issues Log
  • After following these instructions, please provide the information via a helpdesk ticket
GitHub Issue
  • Issue Description: SAS Viya users have reported issues accessing data within Hive due to issues with two of the environment’s worker nodes.
  • What to Expect: The team continues to work with the SAS Vendor to obtain a patch that will resolve the issue. More updates will be shared once more information about the patch is available.
  • Affected Communities: SAS Viya Users
  • Call to Action: A new workaround has been published on this issue. Please follow these instructions found within the Known Issues Log
Maintenance Schedule
  • Updating dates for scheduled CAP & CDR Maintenance events: 
    • March 4
    • April 1
    • May 6
    • June 3
  • All events will begin at 8:00 pm ET and end approximately at 11:00pm ET. A communication will be sent out once maintenance is complete. As a reminder, whenever there is maintenance on the environment, you will need to make sure all of your code and table changes are saved.

Data Source and Usage Updates

Known Issues

  • BIC MBI Sequence - 8/25/2021
    • Ongoing – TBD
  • QMARS Appeals - 6/18/2021
    • Ongoing – TBD
    • Consider using healthcare_service_qmars_ng if your DUA supports it
  • QMARS - 1/12/2021
    • Ongoing - TBD
    • Consider using healthcare_service_qmars_ng if your DUA supports it
CCSQ Support Central

Please watch the presentation for a full walkthrough. 

Learning Objectives:

  • Understand what the CCSQ Support Central is
  • Know how to open and track tickets in the CCSQ Support Central portal

Ways to Open Help Desk Tickets: 

Q&A
The questions are currently being answered by the team and will be posted shortly. 
  1. Would you mind elaborating on how the transition from Hive to S3 will impact our current programming processes? Do we need to worry about syntax updates? Also, what is meant by "intermediate tables" - are those ALL of the tables that we create and then store in the Hive? (We work on the QIN-QIO contract)
    A - As part of the migration, we do not intend to disrupt any of your production workflows. We plan on synchronizing your data from HDFS to S3 in the background for existing hive tables and will work with you to help verify the data sets in new, temporary tables. Once those data sets are validated, we will re-configure your existing hive tables to point to the new S3 locations where the data sets have been copied to, without you having to change any of your existing jobs. No updates will be required on any of your existing code. However, to ensure that all new hive tables created are stored in S3 going forward from there, we will provide documentation on best practices for you to incorporate and reference when writing new jobs. 
  2. Is HCQIS Service Now no longer a viable way to submit support tickets?
    A - It is still a viable way still to open tickets. 
  3. If we have multiple team members, who would obviously have different e-mails, that might be affected by and thus want to check in on the status of a ticket, how can we do so?
    A - Right now, only the submitter will be able to receive the notifications on the tickets. There is an enhancement they are looking into regarding "cc-ing" other individuals on a ticket. 
  4. Is the I/O bandwidth capacity of S3 going to be significantly increased to absorb the additional processing required for accessing the large HIVE schemas from within S3?
    A - After data has been moved to S3, we will assess the impact it will have on query performance and scale the system as needed to maintain current CDR workloads and performance
  5. Will the reconfiguration of these Hive tables to S3 affect our ability to use them in SAS Viya?
    A - It will not as the configurations will take place in the Hive system itself. 
  6. Do I need to request permissions in HARP for this customer portal?
    A - To access the portal, one would not need a HARP license. 
Excerpt IncludeCCSQ Data & AnalyticsCCSQ Data & Analyticsnopaneltrue