Senior Data Engineer (PowerBI & Data Integration)

About the Role

3Pillar is an AI transformation partner dedicated to helping enterprises build AI-native products and intelligent agents. We are looking for a Senior Data Engineer to join our dynamic team and contribute to exciting projects that reshape data analytics for our clients. You will play a crucial role in enabling data-driven decision-making and providing clients with a competitive edge. This is an opportunity to be part of building the future of enterprise AI.

Key Responsibilities

• Collaborate with U.S.-based client stakeholders on solution design and definition, translating business problems into technical specifications.
• Write code and implement proposed solutions.
• Create and manage data pipelines, including versioning and change management.
• Manage the complexity inherent in versioned data pipelines.
• Develop ETL/ELT processes to extract and manipulate data from multiple sources.
• Design, build, and maintain batch or real-time data pipelines in production.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Implement logging and instrumentation for pipelines and services.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

Minimum Qualifications

• Minimum of 5+ years of experience as a data engineer or in a similar role.
• Advanced SQL skills and experience with relational databases and database design.
• Experience with cloud data warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse).
• Strong Python skills with hands-on experience in Pandas, NumPy, and other data-related libraries.
• Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive.
• Proficiency in data pipeline and workflow management tools (e.g., Airflow).
• Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight.
• Experience with AWS, Azure, or GCP data engineering services (specific knowledge of S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM for AWS; or ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB for Azure).
• Extensive experience working with Data Lakes & Data Warehouses solutions.
• Excellent problem-solving, communication, and organizational skills.
• Proven ability to work independently and as part of a team.
• Ability to guide other data engineers.
• High level of English proficiency for direct interaction with U.S. clients.

Additional Experience Desired

• Java and key Java-based frameworks (Spring, Springboot, Hibernate, Apache, etc.).
• Good understanding of NoSQL databases like Redis.

Client-Prioritized Values

• Multi-dimensional contributor: Comfortable wearing multiple hats, multitasking, operating with urgency, being hands-on, and effectively sharing context.
• Consultative approach: Ability to formulate solutions from abstract requirements, balance needs, think proactively, and take ownership.
• Quick ramp, hands-on: Quickly digest product architecture and goals, possess technical curiosity, and eagerness to understand the business drivers.

Benefits

• Medical Insurance benefits as per company policy.
• Life Insurance as per company policy.
• 15 days of paid vacation, sick leave, and paid holidays as per local law.
• Paternity and maternity leave as per local law.
• Marriage, bereavement, and graduation leaves as per company policy.
• Sick leave and paid holidays as per local law.
• Christmas and Mid-year bonuses as per local law.
• Monthly productivity bonus as per local law.
• Discounts in local shops.
• Direct deposit of payroll.
• Paid professional certifications.

What is it like working for 3Pillar Global?

• Flexible work environment: Remote-first approach, offering flexibility in work location.
• Global team: Learn from top talent across cultures, speaking English daily.
• Well-being focus: Dedicated time for well-being initiatives, including fitness and mental health support.
• Accelerated career growth: Opportunities for development across projects, offerings, and industries.
• Equal opportunity employer: Commitment to diversity and values like Intrinsic Dignity and Open Collaboration.