Benzinga is seeking an experienced Data Engineer to join our Data Science team. In this role, you will be responsible for designing, building, and maintaining the systems that collect, store, and process our vast amounts of web traffic, advertising, financial, and product usage data. Your expertise and collaboration with the Data Science team will be crucial in ensuring the integrity, availability, and performance of our data platforms, enabling our team members and partners to make data-driven decisions.
Key Responsibilities:
● Design, develop, and optimize scalable data pipelines to support data collection, transformation, and storage.
● Build and maintain efficient and reliable ETL processes to ingest data from various sources into our data warehouse.
● Ensure data integrity, quality, and security across all data systems and processes.
● Collaborate with stakeholders to understand data needs and deliver solutions that meet business requirements.
● Monitor and troubleshoot data pipeline performance, addressing any issues that arise promptly.
● Implement best practices for data governance, including metadata management, data cataloging, and data privacy compliance.
● Stay current with emerging technologies and trends in data engineering and apply them to improve our data infrastructure.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, a related field, or equivalent experience. A master’s degree is a plus.
- 3+ years of experience in data engineering, software development, or a related role
- Strong experience with cloud platforms like AWS, Google Cloud Platform, or Azure, and familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery.
- Solid understanding of database systems (SQL and NoSQL) and experience with data modeling and schema design.
- Experience with data pipelines or ETL tools such as DBT, Dataform, or Apache Airflow
- Advanced SQL skills
- Proficiency in Python or other programming languages
Preferred Experience:
- Experience using Segment or a similar CDP tool
- Exposure to web application, marketing, or advertising data
- Experience in the financial services or media industry.