Photon Logo

Photon

Hadoop App Support | NJ,Texas

Posted Yesterday
Be an Early Applicant
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
Provide 24/7 production support for Hadoop applications in a Cloudera data lake: monitor SLAs, triage and remediate job failures, collaborate with upstream/downstream teams, analyze and debug shell scripts/Python/Perl, manage large SQL systems, and generate reports for senior management.
The summary above was generated by AI

Position Summary: 

    

Hadoop Application Support specialist able to work in one or more than one applications in the hadoop data lake  

Able to support the existing Hadoop applications.  

Able to support the application in rotating shifts (24x7).  



Job Description: 


Essential Duties and Responsibilities: 

Following is a summary of the essential functions for this job.   Other duties may be performed, both major and minor, which are not mentioned below.  Specific activities may change from time to time. 


Support multiple projects with competing deadlines 

24/7 Monitoring of production applications to make sure SLAs are met 

Triage and Remediation of Job failures 

Work with upstream/downstream applications for any delays or data issues 

Ability to generate and submit the reports to senior management  

Sound understanding and experience with Hadoop ecosystem (Cloudera). Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand. 

Experience in working with a Big Data implementation in production environment 

Experience in HDFS, Map Reduce, Hive, impala, Spark, Kafka &Linux/Unix technologies  is mandatory  

Experience in Unix shell scripting is mandatory 

Able to analyze the existing shell scripts/python/perl code to debug any issues or enhance the code 

Sound knowledge of relational databases (SQL) and experience with large SQL based systems. 

Strong IT consulting experience in various data warehousing engagement, handling large data volumes, architecting big data environments. 

Deep understanding of algorithms, data structures, performance optimization techniques and software development in a team environment. 

Benchmark and debug critical issues with algorithms and software as they arise. 


Required Skills and Competencies: 


Bachelor's degree in a technical or business-related field, or equivalent education and related training 

Seven years of experience in data warehousing architectural approaches and minimum 4 years in big data (Cloudera) 

Exposure to and strong working knowledge of distributed systems  

Excellent understanding of client-service models and customer orientation in service delivery 

Ability to grasp the 'big picture' for a solution by considering all potential options in impacted area 

Aptitude to understand and adapt to newer technologies 

The ability to work with team mates in a collaborative manner to achieve a mission 

Presentation skills to prepare and present to large and small groups on technical and functional topics 


Desired Skills: 

Previous experience in the financial services industry 

Previous experience in production support 

Broad technical experience and good understanding of existing testing/operational processes and an open mind on how to enhance those 

Understanding of industry trends and relevant application technologies 

Experience in designing and implementing analytical environments and business intelligence solutions 


Additional information: 


Hours - 40 per week 

Similar Jobs

7 Minutes Ago
Remote or Hybrid
120K-150K Annually
Senior level
120K-150K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Partner with Finance, Accounting, and Revenue Operations to design and deliver Power BI analytics, semantic models, and decision support for forecasting, close, revenue, and spend analysis. Translate finance concepts into metrics, reconcile data across systems, collaborate with data engineering, and apply AI-assisted tools to automate and scale finance analytics for executives and business partners.
Top Skills: AdaptiveAnaplanClaudeDaxMicrosoft CopilotNetSuiteOnestreamPower BISalesforceSnowflakeSQL
8 Minutes Ago
Easy Apply
Remote
United States
Easy Apply
110K-120K Annually
Junior
110K-120K Annually
Junior
Healthtech • Software
Build and maintain scalable, governed data pipelines from ingestion through transformation and integration. Implement schema validation, data quality checks, job monitoring, and production-grade APIs. Work with Python, SQL, Airflow, dbt, AWS (EMR, Athena, S3), Iceberg/Parquet, and contribute to CI/CD, observability, and on-call support while collaborating with analytics and product teams.
Top Skills: Apache AirflowAPIsAthenaAws EmrCi/CdDbtIcebergKafkaParquetPythonS3SQLTesting Frameworks
9 Minutes Ago
Remote or Hybrid
USA
120K-168K Annually
Mid level
120K-168K Annually
Mid level
Healthtech • Social Impact • Software
Own and architect the People Systems roadmap: build Rippling automations (Workflow Studio), manage sandbox QA, run the annual compliance calendar, maintain HRIS integrations, and mentor People Operations staff. Evaluate AI tooling to reduce manual work and ensure data integrity across people tech.
Top Skills: Ai ToolingAshbyBamboohrBoundlessCartaConsole AiCulture AmpGemKnowbe4NotionPaveRipplingRippling SandboxRippling Workflow StudioSparrowUkgWorkday

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account