Bigdata Engineer -Spark

Marktine Technology Solutions Pvt Ltd

Remote (United States) Remote Full-time 17 days ago
Workplace
Remote
Location
United States
Who can apply
Remote for people based in the United States

Check your CV against this job

Free · No signup · A 0–100 ATS match score and the keywords you're missing.

Check my CV free

$14.99/month in most countries, cancel anytime. Already have an account? Log in

About the role

Category: Technology

Location:

Responsibilities:

* As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies. * Technical Design and development of ETL/Hadoop and Analytics services /components * Contribute in end to end architecture and process flow * Understand Business requirement and publish reusable designs * Result oriented approach with ability to provide apt solutions. * Proficient in performance improvement & fine-tuning ETL and Hadoop implementations * Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies. * Can work independently with minimum supervision. * Strong analytical and problem solving skills * Experience/Exposure to SQL, advanced SQL skills

Requirements

Skills Set:

* Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies. * Hands on experience with batch data ingestion (Sqoop) * Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch) * Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli) * Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra) * Understanding of Agile methodologies as well as SDLC life-cycles and processes. * Strong Understanding of Data warehousing and lakes

Details

Originally posted on Himalayas

About remote Data Engineer jobs

Open jobs
815 open remote Data Engineer jobs, 196 of them posted in the last 7 days. See all Remote Data Engineer jobs
Typical advertised pay
$127,000 – $189,000 a year for the middle half of the 208 job ads from 143 employers that state a salary in US dollars (median $153,000). This is base pay as advertised, not total compensation. Remote Data Engineer salary
Skills the job ads ask for most
  • SQL 80%
  • Python 79%
  • ETL 75%
  • Data modeling 51%
  • Data quality 50%
  • AWS 47%

Share of the 468 newest postings for the role that name each skill. Resume keywords for Data Engineer jobs

Tools and guides for your application

Get matched & apply with FindAJobAI

Upload your resume once. We score every job against your profile, tailor your resume and cover letter, and autofill the application.