Hourly rate: $70/hour to $80/hour on W2
Location: St. Louis, MO (Onsite)
Key Skills: Azure, Databricks, ADF
Key Responsibilities:
- Lead the design, development, and deployment of scalable data pipelines using Azure Databricks.
- Integrate real-time and batch data sources using Apache Kafka and ADF.
- Implement data transformations, enrichment, and quality checks using PySpark/Scala within the Databricks environment.
- Design and develop integrations with Stelo for structured data loading and transformation (if applicable).
- Collaborate with data scientists, analysts, and other engineering teams to deliver business-critical insights.
- Optimize pipeline performance, cost, and scalability in the Azure cloud environment.
- Define best practices for data ingestion, processing, storage, and governance.
- Lead and mentor a team of data engineers, conducting code reviews and ensuring development standards.
- Support troubleshooting and incident management for data-related issues in production.
Required Skills and Qualifications:
- 8+ years of experience in data engineering.
- Strong hands-on experience with Azure Databricks, Apache Spark, and Delta Lake.
- Proven experience integrating and managing streaming data using Apache Kafka.
- Experience using Azure Data Factory for orchestrating and scheduling ETL/ELT processes.
- Familiarity or experience with Stelo for metadata-driven data movement (or similar tools).
- Proficiency in Python, SQL, and optionally Scala.
- Good understanding of data warehousing concepts, data lakes, and big data architecture.
- Knowledge of Azure ecosystem including ADLS, Synapse, Key Vault, etc.
- Excellent analytical, problem-solving, and communication skills.
About Aspire:
Aspire Systems is a global technology services firm serving as a trusted technology partner for more than 275 customers across the globe. Aspire works with the world's most innovative enterprises in Banking, Insurance, Retail and ISVs, helping them leverage technology to transform their business in the current digital landscape. Its proven approach to Software Engineering & Digital Technologies helps companies run smart business models. Aspire’s core philosophy of ‘Attention. Always.’ communicates its belief in lavishing care and attention to its customers and employees. The company currently has over 4900 employees globally and is CMMI Level 3 certified. It operates across North America, LATAM, Europe, Middle East, and Asia Pacific.
Aspire Systems has been recognized for the 12th time in a row as one of the Top 100 ‘Best Companies to Work For’ by the Great Place to Work® Institute. To know more about Aspire Systems, visit https://www.aspiresys.com/.