During Phase One for Databricks, will Zeppelin be decommissioned?
A - The end goal is to sunset Zeppelin, but it will not be as quick as once we release Databricks.
Is Databricks taking the place of SAS Viya? If not, will we be able to continue to use SAS Viya and HiveQL code language?
A - Databricks is not replacing Viya. In the Phase Two release, users will be able to connect Viya or other tools like Redshift to Databricks. Training will be provided on training to ANSI SQL since Databricks supports this instead of HiveQL.
Will a recording be available for us to review on our own later?
A - All micro-training videos shown during the Townhalls will be made available out on Confluence for everyone to reference.
Do we need separate Healthcare Quality Information Systems (HCQIS) Access Roles and Profiles (HARP) user role for Databricks?
A - Yes. Onboarding information will be sent in an email that includes your onboard date, training material, and support.
Does Databricks have access to existing workbench (S3)?
A - It will. - Can users install and load R packages by themselves?
A - Yes. Will it be a requirement to eventually use DataBricks or can we continue working in SAS Viya if we prefer?
A - No, users can continue using SAS Viya. The endpoint will be changed. Users will be using the SQL warehouse for Databricks.
Will the python notebook have ML functionality in a future release?
A - Yes.
Do the Databricks website trainings require us paying to access them? A lot of sites like SAS Viya and Tableau require payments to access trainings.
A - No. The Databricks company has many free video trainings users can leverage.
What specific HARP role do we need to request?
A - Onboarding instructions containing HARP role information will be shared shortly.
Is there an upper limit for how many jobs one user can submit simultaneously? Is there an upper limit for memory usage or time running?
A - Databricks has can auto-scale. Once it hits a certain memory usage, the job will be killed automatically.
Will MSDRG be add to Complete Statistical Analytic Table (CSAT)?
A - The D&A Team left in the claim_sk join field to all the tables to make it easier for end users to join with other data sets. MSDRG data is at the claim level, so it’s only the claim_sk from the claim_sgmt_line_num = 1. Assuming that users are working at the claim level in CSAT, users should be able to join to the claims_msdrg_output table on claim_sk.
Also, does the claim id issue relate to CSAT?
A - The duplication isn't affecting CSAT at this time.
When will the Training Hub be available?
A - The Training Hub- Archive is already available today.