LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets.
Description:
We are seeking a talented and passionate Databricks Engineer with 6+ years of experience to join our growing data engineering team. The resource must act as a bridge between the offshore and the stakeholders. In this role, he/she must help architect, implement, and manage cloud-based data solutions using Databricks and associated technologies (Azure, AWS). The ideal candidate will have experience in developing, optimizing, and maintaining data pipelines, analytics workflows, and data lakes, leveraging Databricks to drive business insights.
Responsibilities:
Data Pipeline Development: Build and maintain scalable and optimized data pipelines using Apache Spark, Databricks, and other cloud-based tools to ensure efficient data flow across systems.
Cloud Infrastructure: Work with cloud providers (Azure, AWS) to design and implement cloud-native solutions for data storage, processing, and analytics. Experience with Databricks in a cloud-based environment is essential.
Collaboration with Data Scientists/Analysts: Collaborate with data scientists, analysts, and business stakeholders to transform business requirements into data solutions and deliver meaningful insights.
Optimization: Continuously optimize Spark and Databricks workflows for performance and cost efficiency.
ETL & Data Integration: Implement ETL processes to integrate data from various sources (SQL, NoSQL, REST APIs) into Databricks environments and data lakes.
Data Governance: Ensure data security, privacy, and compliance policies are followed, including managing data access, monitoring usage, and implementing data lineage.
Monitoring & Troubleshooting: Proactively monitor and troubleshoot data pipelines, performance bottlenecks, and integration issues.
Documentation & Best Practices: Document solutions, architectures, and workflows while enforcing coding best practices within the team.
Skills:
...a commercial mindset to balance creativity and cost. Co-own the Build-Smarter and sustainability initiative. Partner with global KFC teams, construction team as well as finance team. Owns vendor performance management and relationships with approved design consultants...
About the Job Ruan is looking for Class A CDL hazmat drivers based in Madison, WI, to transport and deliver liquid oxygen, nitrogen, or argon for a dedicated customer. Cryogenic liquids are used in a variety of food, medical, and industrial applications from the production...
Become a clinical Registered Dietitian at American Senior Communities today! Ask About our New Wages Being Offered Come Join Our Team of More than 40 Dietitians! Registered Dietitians play an important role in enhancing the overall health and quality of life for...
...for a hybrid work schedule with 3 days/week in the Burnsville, MN location. ****Job Description**The **Senior Product Manager - Amplifiers and Electronics** is responsible for the product management of Dynacord commercial amplifiers and electronics worldwide, a major...
...Catering Manager - Fiserv ForumClick Here to Apply OnlineJob Description Levy Sector Different perspectives make us better. We're committed to creating an equal opportunity and fair treatment environment, where learning and growing together is just part of our every day...