Solutions Architect, Data Engineering & Lakehouse Lake

About the Role

Key Responsibilities

• Be well-versed in migrations of applications, code, and data onto cloud platforms and lead design of services on Snowflake, including lakehouse architectures using Iceberg.
• Outline the architecture of Spark, Scala, and Cloudera environments.
• Guide customers on architecting and building data engineering pipelines on Snowflake, including streaming data ingestion and processing.
• Design and implement data ingestion and transformation pipelines using Apache NiFi and architect Iceberg-based lakehouse solutions on Snowflake.
• Run workshops and design sessions with stakeholders and customers.
• Troubleshoot migration and implementation issues.
• Create repeatable processes and documentation based on customer engagement, scripting using Python and shell scripts for ETL workflows.
• Develop best practices and ensure knowledge transfer for customer enablement.
• Provide guidance on resolving customer-specific technical challenges.
• Outline testing strategies and plans.
• Optimize Snowflake for performance and cost.
• Design and implement solutions for streaming data ingestion and processing.
• Communicate requirements for Snowpark conversion, back-end big data frameworks, and platform enhancements.
• Contribute to frameworks for distributed computing, Spark, PySpark, Python, HBase, Kafka, REST APIs, and Machine Learning as part of Snowconvert and modernization efforts.
• Provide input on Snowflake's Lakehouse capabilities and Iceberg integration.

Requirements

• Bachelor's degree in a technical discipline or equivalent practical experience.
• 6+ years of experience in a customer-facing technical role with complex implementation projects and digital transformation engagements.
• Experience in Data Warehousing, Business Intelligence, application modernization, lakehouse implementations, or Cloud projects, including building real-time and batch data pipelines using Apache Spark and Apache NiFi.
• Experience with implementing Apache Iceberg or other open table formats (Delta, Hudi) based lakehouse solutions.
• Experience with streaming data technologies and patterns.
• Experience with Cloudera platform and migrations from Cloudera.
• Ability to learn new technology and build repeatable solutions/processes.
• Ability to anticipate project roadblocks and have mitigation plans.
• Proven ability to communicate effectively across multiple groups, from design and engineering to client executives and technical leaders.
• Outstanding presentation skills for technical and executive audiences.
• Ability and flexibility to travel to work with customers on-site as needed.

Nice to Have

• Experience with Snowpark conversion for Scala/Python and Spark-based backend software modules.
• Experience with big data frameworks such as HBase, Kafka, REST APIs, and Machine Learning tools.
• Knowledge of Snowflake's Lakehouse capabilities and Iceberg integration.

Qualifications

• Formal educational background in a technical discipline or equivalent experience.

Benefits & Perks

• Competitive salary with an estimated base range of $128,000 - $178,500.
• Participation in Snowflake's bonus and equity plan.
• Comprehensive benefits including medical, dental, vision, life, and disability insurance.
• 401(k) retirement plan.
• Flexible spending and health savings accounts.
• At least 12 paid holidays, paid time off, parental leave, and employee assistance programs.