Build and scale data pipelines and partner integrations for an end-of-life open-source software dataset. Responsibilities include improving data quality, designing configurable risk-scoring models, integrating Kafka and data lakes, automating package generation and publishing, implementing monitoring and CI/CD, and documenting systems. The role also involves technical design, code reviews, mentoring, and collaboration with product and partner-facing teams.
Senior Software Engineer - IntegrationsAbout the job
HeroDevs is hiring a Senior Software Engineer for our Evergreen team. HeroDevs keeps critical open-source software secure long after it reaches end of life. The Evergreen team owns EOLDS, our end-of-life dataset, which internal teams and integration partners rely on to understand which open-source software has reached end of life, the risk that carries, and how to remediate it. We also build the systems that turn that data into packages our partners can consume, and we need those systems to produce packages at scale when a partner needs them.
Position SummaryWe're looking for a Senior Software Engineer to help take EOLDS to its next stage. You'll help build the pipelines that let us generate and publish large numbers of packages for partners on demand. This is a high-ownership role. You'll make design decisions, set patterns for the team, and work closely with partner-facing teams to understand what partners need from the data.
Responsibilities- Improve EOLDS data quality through validation, deduplication, provenance tracking, and automated checks that catch regressions before they reach partners
- Investigate and document how our current risk heuristics work, including their inputs, assumptions, and edge cases
- Design and build a multi-model risk scoring framework that supports different risk profiles for remediation, including CVE-centric models alongside our existing heuristics
- Build weighted, configurable scoring so risk profiles can be tuned per partner or use case, with clear explanations of how a score was produced
- Integrate EOLDS with Kafka and our data lake, including event schemas, producers and consumers, backfills, and consistency between systems
- Build automated pipelines that can generate, version, and publish large numbers of packages for partners on demand, reliably and reproducibly
- Add monitoring and data quality metrics so problems with the dataset, scoring, or package delivery surface quickly
- Work with product and partner-facing teams to translate partner requirements into data and scoring changes
- Write services and tooling in TypeScript/Node.js, with automated testing and CI/CD
- Review code and designs, mentor other engineers, and help raise the team's engineering bar
- Write clear documentation for the dataset, scoring models, and pipelines you build
- Work to automate package requests from our partners
- 5+ years of professional software engineering experience, with significant time spent building data-intensive systems or data pipelines in production
- Proficiency in TypeScript/JavaScript (Node.js)
- Experience with event streaming platforms such as Kafka, and with data lakes or data warehouses
- Strong SQL and data modeling skills
- Experience designing data validation and data quality checks for datasets other teams or customers depend on
- Comfort reasoning about scoring, ranking, or heuristic systems, such as weighted models or risk scores, and explaining their tradeoffs
- Experience building build, release, or publishing automation, including CI/CD pipelines
- The ability to dig into an unfamiliar system, figure out how it works, and write it down so others can understand it
- Strong written communication and the ability to drive technical decisions in a distributed team
- Bachelor's degree in Computer Science or a related field, or equivalent practical experience
- Experience with git-based software development (preferably on GitHub)
- Familiarity with vulnerability data and scoring, such as CVEs, CVSS, EPSS, CISA KEV, OSV, or GitHub Security Advisories
- Experience with package ecosystems and their publishing workflows, such as npm, Maven, PyPI, RPM, or Debian packaging
- Experience with schema registries and serialization formats such as Avro or Protobuf
- Experience with lakehouse table formats such as Apache Iceberg, Delta Lake, or Parquet-based storage
- Background in software supply chain security, including SBOMs, artifact signing, or provenance (e.g., Sigstore, SLSA)
- Experience working with enterprise partners on data delivery or integrations
- Experience mentoring engineers or acting as a technical lead
- Interest in open-source software and long-term maintenance of critical software
- Experience with Temporal Cloud or similar orchestration solutions
- Experience with OpenSearch and/or ElasticSearch
- Experience with OTEL/opentelemetry and Grafana
- Experience with Argo UI
Similar Jobs
Fintech • Software • Financial Services
Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.
Top Skills:
AirflowArgo WorkflowsChange Data CaptureDatadogDbtFivetranKubernetesPythonReverse EtlSegmentSnowflakeSQL
Fintech • Software • Financial Services
Build and architect Clear Street Active, a high-performance trading platform for active traders. Develop responsive web interfaces integrating real-time market data, low-latency execution workflows, and advanced trading tools. Collaborate with cross-functional teams on large-scale initiatives while emphasizing scalability, performance, API quality, maintainability, and developer experience.
Top Skills:
ReactTailwindTanstackTypescript
Fintech • Software • Financial Services
Own the reliability and quality of an AI copilot for trading platforms. Build evaluation frameworks, benchmarks, quality gates, monitoring, incident response, and model improvement loops. Partner with engineering and product on safe tool interactions, auditability, and user trust. Develop trading-domain expertise and measurement systems covering correctness, safety, latency, regression risk, and workflow performance.
Top Skills:
Evaluation PipelinesLlm ApisModel ServingObservability And Telemetry ToolingPostgresReactReact NativeRustTraining PipelinesTypescript
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
