Spectraforce Technologies logo

Developer IV (Big Data Engineer)

Spectraforce Technologies

Columbia, SC
Contract
Senior
108k-108k
9 days ago

Job Description

About the Role

The Developer IV (Big Data Engineer) role involves analyzing, designing, programming, and implementing complex applications and systems within a customer-focused, fast-paced, multi-platform environment. The position is part of the Commercial Systems Information Management (CSIM) aka Data Lake Team in Columbia, SC, with partially onsite work and a duration of 11+ months. The role requires providing technical guidance, developing enterprise-level applications, and ensuring solutions align with business and IT strategies.

Key Responsibilities

  • Analyze, design, program, and implement the most complex applications tasks and projects in the area.
  • Devise feasible, logical procedures to resolve business problems through the use of computer resources.
  • Formulate scope and objectives through research to develop or modify complex systems.
  • Provide technical direction and support in the development and support of business systems software and procedures.
  • Design, code, test, and debug the most complex application programs.
  • Provide expertise regarding the integration of applications across the business.
  • Conceive, design, and implement structures and programs to business systems software.
  • Act as an internal consultant, advocate, mentor, and change agent providing expertise and technical guidance on complex projects.
  • Work closely with customers, business analysts, and team members to determine business requirements that drive the analysis and design of technical solutions.
  • Ensure solutions are aligned with business and IT strategies and comply with architectural standards.
  • Provide design recommendations based on long-term IT organization strategy.
  • Make recommendations towards the development of new code or reuse of existing code.
  • Participate in component and data architecture design, performance monitoring, product evaluation, and buy versus build decisions.
  • Perform analysis, design, programming, and implementation on systems and procedures to solve complex business or scientific problems.
  • Develop enterprise-level applications and custom integration solutions.
  • Evaluate complex interrelationships in programming areas to determine how changes affect related systems.
  • Develop programming and development standards, devise new sources of data, and develop new approaches and techniques.
  • Design, code, test, implement, maintain, and support application software throughout the full systems lifecycle.
  • Provide guidance to lower-level programmers/analysts.
  • Lead, plan, organize, and coordinate complex projects or phases of large projects.
  • Research application development quality control trends throughout the industry.
  • Review and analyze systems, streamline processes, and develop technology solutions and prototypes.
  • Research, diagnose, and develop fixes for defects in existing code.
  • Address maintenance issues related to current development, testing, and production.

Requirements

  • 8 years of application development, systems testing, or other related experience.
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience in big data technologies.
  • Experience in cloud-based technologies.
  • Hands-on experience with AWS Services including State Machines, CDK, Glue, TypeScript, CloudWatch, Lambda, CloudFormation, S3, Glacier, DataSync, Lake Formation, AppFlow, RDS PostgreSQL, Aurora, Athena, Amazon MSK, Apache Iceberg, Spark, Python.

Nice to Have

  • AWS Redshift
  • Databricks - delta Lake
  • Unity catalog
  • Data Engineering and processing using Databricks
  • AI and Machine Learning Amazon Bedrock
  • AWS Sagemaker, AWS Sagemaker Unified Studio
  • R Studio / Posit Workbench, R Shiny / Posit Connect
  • Posit Package Manager
  • AWS Data Firehose
  • Kafka
  • Hive
  • Hue
  • Oozie
  • Sqoop
  • Git/Git Actions
  • IntelliJ
  • Scala

Benefits & Perks

  • Position's starting pay is $52.00/hr.
  • Information on benefits, equal opportunity employment, and location-specific applicant notices available via provided link.
Apply Now

Job Details

Posted AtJul 15, 2025
Job CategoryData Engineering
Salary108k-108k
Job TypeContract
Work ModeHybrid
ExperienceSenior

Job Skills

AI Insights

Key skills identified from this job posting

Sign upto access all insights for this job

About Spectraforce Technologies

Website

spectraforce.com

Location

Columbia, SC

Industry

Employment Placement Agencies

Get job alerts

Set up personalized alerts for your job search and get tailored job digests for close matches