Design and implement large-scale data applications using Java, Spark, and MapReduce within Cloudera/Hadoop ecosystems. Integrate Hive, Impala, YARN, and Kafka, perform data analysis, write tests (JUnit), use scripting, and manage global technology teams following industry best practices.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Design, develop, and maintain Tableau and Power BI dashboards and data solutions for Supply Chain. Implement AI/ML models with Enterprise AI team, build ETL pipelines, perform ad-hoc analysis and automation, own KPIs, ensure data governance, provide training/support, and participate in QA and UAT to deliver actionable insights for operations.
Top Skills:
AlteryxDataikuETLGoogle Ai StudioKnimeMicrosoft Azure AiPower BIPythonSQLStack AiTableau
Cloud • Information Technology • Security • Software • Cybersecurity
Serve as a quota-carrying technical trusted advisor owning discovery, architecture, demos, PoCs, onboarding, and adoption. Drive commercial outcomes, expansion, and executive-level technical reviews. Leverage AI-augmented workflows to automate routine tasks and focus on high-value architecture, integration troubleshooting, and customer telemetry to ensure time-to-value.
Top Skills:
Ai GatewayApi ConnectorsCloud InfrastructureCloudflare Developer PlatformCloudflare Workers AiDdos MitigationDnsEdge ComputingJavaScriptLlmPythonRagRoutingVectorize
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Own architecture and technical direction for Headway's Journey communications platform: design the decision engine, experimentation layer, channel orchestration, unified message ledger, and productionize LLM-powered personalization across multi-vendor delivery systems to improve patient and provider engagement.
Top Skills:
SparkAws EcsAws FargateDatadogFastapiGitIterableKafkaKnockLaceworkLlmMailgunNext.JsPagerdutyPostgresPython 3ReactRedisRemixS3SemgrepSentrySnykSqlalchemyTwilioTypescript
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
