Big Data Architect
This job was posted on 2024-09-17 19:23:33.
Big Data Architect
Client: OCTO, DC
Location: Washington DC
Rate: $90/hr on c2c/1099
100% onsite
Local candidate only
Job description:
This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications. This is an exciting opportunity to work as a part of a collaborative senior data team supporting DC's Chief Data Officer.ย This architecture includes Databricks, Microsoft Azure platform tools (including Data Lake, Synapse) and data pipeline/ETL development tools (including Streamsets, Azure Data Factory).ย The platform will be designed for District wide use and integration with other OCTO Enterprise Data tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle databases and integration tools.
Skills:ย
- 5 years Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes
- 5 years Knowledge of modern Big Data and Data Architecture and Implementation best practices
- 5 years Knowledge of architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure
- 5 years Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure
- 5 years Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle
- 5 years Experience querying structured and unstructured data sources including SQL and NoSQL databases
- 5 years Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines
- 3 years Experience with API / Web Services (REST/SOAP)
- 3 years Experience with complex event processing and real-time streaming data
- 3 years Experience with deployment and management of data science tools and modules such as JupyterHub
- 3 years Experience with ETL, data processing, analytics using languages such as Python, Java or R
- Databricks Certified Data Engineer Professional - Highly desired
- 3 years Experience with Cloudera Data Platform - Highly desired
- 16+ yrs planning, coordinating, and monitoring project activities
- 16+ yrs leading projects, ensuring they are in compliance with established standards/procedures
- Bachelorโs degree in IT or related field or equivalent experience
1) Please email your resume to Linesh Shah at lineshshah@gmail.com
2) Mention the job title Big Data Architect with OCTO, DC .
More Jobs
๐๏ธ T-SQL Developer: SME - K12/Education domain [Remote] [2024-10-01 18:31:53]
๐๏ธ Sharepoint Administrator [Remote] [2024-10-01 18:32:25]
๐๏ธ Dynamics Consultant and CRM/Power Platform Developer Lead [2024-10-01 15:13:41]
๐๏ธ Business Analyst (DC Government) [2024-09-22 20:53:01]
๐๏ธ Data Analyst [2024-09-22 20:49:05]
๐๏ธ Big Data Architect [2024-09-17 19:23:33]
๐๏ธ Business Analyst [2024-09-12 21:08:59]
๐๏ธ Oracle Database Administrator (DBA): Oracle and SQL DB Support - MDOC [2024-09-12 16:16:28]
๐๏ธ Dynamics Consultant and CRM/ Power Platform Developer Lead [2024-09-09 22:40:19]
๐๏ธ Senior QA Specialist [2024-09-09 18:01:08]
๐๏ธ Software Tester - Entry Level [2024-09-09 16:37:58]