Data



Back to Townhalls Home Page

CCSQ Data & Analytics Townhall

Date

Wednesday, August 30, 2023, at 1:00 pm ET

Recording

August Townhall  

Agenda

  1. Monthly Satisfaction Survey Review & Poll
  2. Upcoming Databricks (DBX) Training
  3. Ambari Decommission Update
  4. Bring Your Own Analytics (BYOA) Migration
  5. Recent Databricks Releases
  6. Q&A
Monthly Satisfaction Survey Review

Reference the recording to see the results of the previous month's poll (1:06). 

Upcoming Databricks Training

New Training:

  • Databricks Overview Video
  • Databricks Language Overview

Upcoming Training:

  • SAS to DBX
  • Intro into R
  • Multiple Best Practice Articles

Training Hub

Ambari Decommission and Transition Updates

Decommissioning Process

  • What is needed to fully turn off Ambari?
  • CASLIB Migration
  • SAS users onboard to structured query language (SQL) cluster.
  • BYOA migration
  • Hive to Glue migration

Where are we now?

  • SQL Cluster Release - Done
  • CASLIBS - In Progress
  • Estimated Completion - Sept 1st maintenance weekend
  • BYOA Migration – In Progress
  • Estimated Completion – Prior to Sept 29th maintenance weekend
  • Hive to Glue Migration Prep – In Progress
  • Migration Estimated Completion – Post Ambari Decommission

Why are we migrating?

  • Better performance and stability
  • Faster querying times
  • Less unplanned maintenance
  • More opportunity for us to invest in better features for you.
  • Faster deliverables for you all!

Take the Ambari Decommission Survey 

BYOA Migration

What is a BYOA connection?

  • BYOA stands for Bring Your Own Analytics.
  • Use a tool that is owned in your environment to connect and perform analysis on data located in the Data & Analytics environment.
  • Examples of some tools: Redshift, Quicksight, electronic medical records (EMR), Snowflake.

How does this relate to Databricks?

  • Currently all connections are made to Ambari.
  • Since this is an external connection, we need to work with our user community to move those connections from Ambari to Databricks.
  • We have received feedback from almost all customers regarding the transition.

Support

  • Documentation is readily available on the CCSQ training site regarding the network changes needed.
  • Connect SAS BYOA/BYOD to DBX SQL
  • We are here to meet with you and support your move
Recent Databricks Releases

Databricks - Notebook Release

  • What does this entail?
  • All native notebook capabilities and library installations.
  • Languages: Python, R, Scala, SQL
  • Workbench and Centralized Data Repository (CDR) Data
  • Two different Clusters- R/machine learning (ML), Python/SQL
  • Users can share their notebooks.
  • Users can visualize their results.

SQL Cluster Release

  • What does this entail?
    • One for whole community vs per organization.
  • How can you connect?
    • Only using of a Service Principal and Token.
  • Known differences/issues between SAS and DBX.
  • Document will be shared with user community.

Support

Training

  • Located on the user facing CCSQ site.
  • Please input training request through this page under the support menu.
Q&A

8-30-2023 Townhall Q&A

  • No labels