Golang Engineer (Databricks Experience)

*Candidates must possess work authorization which does not require sponsorship by the employer for a visa.


About Infinitive:

Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize their data to generate lasting value. They pride themselves on their deep industry and technology expertise, ensuring that they drive and sustain the adoption of new capabilities. Infinitive is committed to aligning their team with their clients' culture, ensuring a successful partnership by bringing the right mix of talent and skills for high return on investment.

Infinitive has earned recognition as one of the "Best Small Firms to Work For" by Consulting Magazine, receiving this accolade seven times, most recently in 2024. They have also been honored as a “Top Workplace” by the Washington Post, “Best Places to Work” by the Washington Business Journal, and “Best Places to Work” by Virginia Business.
 

Job Description:

We are seeking a talented Golang Engineer with Databricks experience to join our dynamic team. In this role, you will work on designing and implementing efficient backend services and data solutions to support our growing analytics and data pipeline initiatives. You will leverage your experience in Golang development and your knowledge of Databricks and Apache Spark to optimize and build scalable applications that meet business and technical requirements.

Responsibilities:

• Design, develop, test, and deploy backend services and microservices using Golang, ensuring high performance and responsiveness.
• Collaborate with data engineers and data scientists to build scalable data pipelines and analytic workflows within Databricks and Apache Spark environments.
• Optimize and tune Databricks and Spark jobs to ensure efficient resource utilization, cost-effectiveness, and speed.
• Develop integrations between Databricks, cloud storage solutions, and other systems.
• Collaborate on system design, API development, and data workflows to support data-driven applications.
• Write efficient and maintainable code following industry standards and best practices.
• Document processes, design, and code for knowledge sharing and future reference.
• Troubleshoot, debug, and resolve issues in production environments.
• Participate in code reviews and contribute to continuous improvement initiatives.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
• 3+ years of experience in Golang development with a strong focus on backend services and microservices.
• Hands-on experience with Databricks and Apache Spark in data engineering or analytics projects.
• Proficiency in writing and optimizing SQL for large datasets, and experience with data processing frameworks.
• Experience with cloud platforms such as AWS, GCP, or Azure, and knowledge of cloud-based data storage solutions (e.g., S3, Cloud Storage, ADLS).
• Familiarity with DevOps tools, CI/CD pipelines, and version control (e.g., Git).
• Experience with Docker and Kubernetes for containerization and orchestration is a plus.
• Knowledge of RESTful API development and integration with data systems.
• Strong analytical and problem-solving skills with attention to detail.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.

Preferred Skills:

• Experience in Python or Scala for additional support with Databricks workflows.
• Knowledge of data lake and data warehousing technologies, such as Snowflake, Redshift, or BigQuery.
• Familiarity with Spark optimization techniques, including performance tuning and cost management.
• Experience in Agile methodologies and project management tools.