xg2xg: Google Internal to Open-Source/Cloud Mapping

repository·master·Indexed 29 days ago

A lookup table designed to help developers transition from Google's internal technologies to real-world, open-source, or cloud-based alternatives. Includes mappings for core technology, infrastructure, storage, services, DevOps, security, and engineering management tools.

Tokens: 2.6K
Snippets: 0
Records: 11
Agent score: 97%

What's inside xg2xg

Map Miscellaneous Google tools to real-world alternatives
master
Use this mapping to find industry-standard or open-source replacements for Google internal miscellaneous tools:
- Documentation: Replace g3doc with writethedocs or docs-as-code patterns.
- Knowledge Management: Replace MOMA with Glean.
- Communication: Replace gchat with Slack or Mattermost.
- Ticketing/Support: Replace GUTS with Spoke or Freshservice.
- Software Engineering Knowledge: Refer to Software Engineering at Google (book) for industry-standard practices.
https://github.com/jhuangtw/xg2xg/blob/master/README.md
Map Security tools to real-world alternatives
master
Use this mapping to find industry-standard or open-source replacements for Google internal security technologies:
- Identity & Access: Replace prodaccess/LOAS with Keymaster or SPIFFE.
- Secrets & Identity Management: Replace prod secrets with chamber, knox, or SPIFFE.
- Zero Trust: Replace beyondcorp with beyondcorp (external version).
https://github.com/jhuangtw/xg2xg/blob/master/README.md

Map PeopleOps and Culture tools to real-world alternatives

master

Use this mapping to find industry-standard software and platforms that serve as equivalents to Google's internal PeopleOps and culture-building tools:

Google Internal	Real-World Alternatives
OKR	CultureAmp OKR, Lattice Goals, Ally, workboard
HRIS/ERP	Namely, BambooHR, Workday, Paylocity
peer bonus	bonus.ly
kudos	heytaco, slack ++ bot
perks	fond
dory	slido, dory(app)
googlegeist	Culture Amp, humu, tinypulse, peakon
edge, people ops training	LifeLabs

Additionally, for community events and Slack channels, refer to xoogler.co.

Map DevOps tools to real-world alternatives
master
Use this mapping to find industry-standard or open-source replacements for Google internal DevOps tools:
- Build Systems: Replace Blaze with Bazel, Buck, Pants, please.build, or EngFlow. Replace Sponge or Forge/ObjFS with EngFlow or flare.build.
- CI/CD: Replace Blaze/Forge/TAP/BuildCop with buildkite, CircleCI, github (Actions), gitlabCI, or jenkins. Replace Sisyphus / Rapid with Spinnaker, lambdaCD, or AWS CodeDeploy.
- Monitoring & Observability: Replace varz/borgmon/monarch or Viceroy with Datadog, Prometheus, Grafana, or New Relic. Replace Dapper with OpenTelemetry, Jaeger, or Zipkin.
- Configuration Management: Replace borgcfg / gcl or Prodspec with Terraform, Pulumi, Ansible, Chef, or Kubecfg.
- Incident Management: Replace Oncall with PagerDuty, OpsGenie, or VictorOps.
- Code Search & Review: Replace CodeSearch/Grimoire with Sourcegraph or OpenGrok. Replace Critique/Gerrit with Reviewable or Phabricator.
- Issue Tracking: Replace buganizer with JIRA, GitHub Issues, or Linear.
- Containerization: Replace MPM with Docker or OCI standards.
https://github.com/jhuangtw/xg2xg/blob/master/README.md
Map IT and Operations tools to real-world alternatives
master
Use this mapping to find industry-standard or open-source replacements for Google internal IT and miscellaneous tools:
- Secrets Management: Replace valentine with Vault, 1Password, Lastpass, or pass.
- Code Ownership: Replace OWNERS files with github CODEOWNERS.
- Short Links: Replace go/ links with golinks, go, or `trot
https://github.com/jhuangtw/xg2xg/blob/master/README.md
Map Google internal technologies to real-world alternatives
master
The xg2xg repository provides a lookup table to help developers (specifically ex-Googlers) transition from Google internal technologies to external Google Cloud products, open-source projects, or SaaS offerings. The mapping is categorized into Core Technology, Infrastructure, Storage, and Services.
Core Technology Mappings
- MapReduce: Use Apache Hadoop or Spark.
- Flume: Use DataFlow or Apache Beam.
- Protocol Buffer: Use Protobuf or FlatBuffers; alternatives include Thrift or Avro.
- Stubby: Use gRPC or Thrift.
- Chubby: Use Apache Zookeeper, etcd, or HashiCorp Consul.
- Goops / PubSub: Use Cloud Pub/Sub or Apache Kafka.
- //base: Use abseil.
Infrastructure Mappings
- Borg: Use Kubernetes, Apache Mesos, or HashiCorp Nomad.
- GSLB: Use Cloud Load Balancing or Istio.
- Zanzibar: Use SpiceDB, Ory Keto, or OpenFGA.
Storage Mappings
- GFS/Colossus: Use HDFS or Ceph.
- Bigtable: Use Cloud Bigtable, Cassandra, or HBase.
- Spanner: Use Cloud Spanner, Vitess, or CockroachDB.
- ColumnIO / Capacitor: Use Apache Parquet or Apache Iceberg.
- sstable: Use RocksDB or pebble.
Services Mappings
- Dremel: Use BigQuery, Apache Drill, or Snowflake.
- Search: Use Elasticsearch or Algolia.
- MillWheel: Use Cloud Dataflow or Apache Flink.
- Colab: Use Jupyter or Observable.
https://github.com/jhuangtw/xg2xg/blob/master/README.md
Find Engineering Management tools for Process and Decision Making
master
Use these resources to optimize team workflows and decision-making:
1:1s and Check-ins
- Facilitation/Nudge Engines: Range.co, KnowYourTeam, Readymetrics, and Humu.
Meetings and Facilitation
- Frameworks: Six Thinking Hats.
- Optimization: Google Calendar 'speedy meetings' setting.
Decision Making Frameworks
- Models: DACI (Atlassian Team Playbook) and the Eisenhower Method for time management.
- Responsibility: RACI (Responsibility Assignment Matrix).
https://github.com/jhuangtw/xg2xg/blob/master/EM.md
Find Engineering Management tools for People and Team development
master
Use these resources to manage team dynamics, individual growth, and personnel assessment:
Understanding Self and Team
- Assessments: Myers-Briggs, StrengthsFinder, DISC assessment, Enneagram, and Standout.
- Frameworks: The Muppet Theory and Neil on Software.
Career Conversations and Growth
- Frameworks: Radical Candor, Ikigai, and Progression.fyi.
- Staff Engineering: staffeng.com.
Team and Code Health
- Team Health: Atlassian Team Playbook (Health Monitor).
- Code Health: scc (Source Code Counter).
Mentorship and Coaching
- Technical Mentors: Codementor.io.
- Engineering Management (EM) Coaching: Platohq.com.
- Professional/Executive Coaching: Workbravely, BetterUp, and Athena Alliance.
https://github.com/jhuangtw/xg2xg/blob/master/EM.md
Find Engineering Management tools for Hiring and Recruiting
master
Use these resources to manage the end-to-end hiring lifecycle:
Hiring Distributed and Contract Engineers
- Platforms: Remotive, Terminal, Pilot, Arc.dev, Worca, Turing, Deel, Boundless, Meet.jobs, 10xmanagement, Facet, Toptal, X-Team, and Symphony.
Interviewing-as-a-Service and Assessment
- Services: Karat, Hired, Interviewing.io, CodeSignal, and Qualified.io.
Sourcing and Referrals
- Sourcing: Traitly, Dover.
- Referrals: Teamable.
Diversity and Inclusion (D&I)
- Communities/Platforms: Gaingels, DevColor, Code2040, ColorStack, Women Who Code, NextPlay, Techqueria, GirlGeek, DiversifyTech, and AfroTech.
Recruiting and Executive Search
- General Recruiting: Bincsearch.
- Security Focused: Codered Partners.
- Executive Recruiting: Riviera Partners, Davers Partners.
Leveling and Compensation
- Frameworks: Dropbox Career Framework, Staffeng.com, and Levels.fyi.
https://github.com/jhuangtw/xg2xg/blob/master/EM.md
Find utilities for data manipulation and testing
master
For quick data tasks, use these specialized utilities:
- Query CSVs with SQL: Use cq.
- JSON processing: Use jq.
- Generating fake data: Use mimesis.
https://github.com/jhuangtw/xg2xg
Identify Data Infrastructure alternatives
master
Use the following categorized list of industry-standard tools to find alternatives for various data infrastructure needs:
Distributed Frameworks
- spark
- ray
- dask
Warehouse
- redshift
- snowflake
- bigquery
- vertica
Data Lake
- databricks delta
- apache iceberg
- apache hudi
- dremio
Change data capture / streaming
- attunity
- streamsets
- debezium
Data Versioning
- projectnessie
OLAP
- apache pinot
- apache kylin
Streaming
- kafka
- flink
- beam
Real-time/Document-search
- elasticsearch
- rockset
Notebooks / Exploration
- jupyter
- apache zeppelin
- Optimus
- colab.research.google.com
- saturncloud.io
- rmarkdown.rstudio.com
- querybook.org
- deepnote.com
- cnvrg.io
- dominodatalab
Labeling
- snorkel.org
- figure-eight.com
- scale.ai
- labelbox.com
Notebook Management
- papermill
Orchestration
- airflow
- luigi
- oozie
- dagster
- prefect
- dbt
Dataflow/Transformation Managers
- streamset
- nifi
Unstructured/Semi-structured Data Prep
- trifacta.com
Data Quality Monitoring
- anomalo.com
- deequ
Anomaly Detection as a Service
- anodot.com
Event Data
- segment
- Rudderstack
- Metarouter
- snowplow
A/B Testing
- optimizely.com
- abtesty.com
- mendel
Behavioral Analytics
- fullstory.com
- hotjar.com
Feature Flagging
- launchdarkly.com
- split.io
- flagr
Authorization
- osohq.com
Catalogue / Metadata
- airbnb knowledge-repo
- lyft amundsen
- uber databook
- netflix metacat
- google cloud data catalog
- linkedin datahub
BI
- apache superset
- looker
- periscope
ETL / Ingestion-as-a-service
- fivetran
- singer.io
- talend
- airbyte
- brooklin
Reverse-ETL
- tray.io
- snaplogic.com
- polytomic.com
- census.com
Sales Analytics
- chorus.ai
- gong.io
Timeseries Forecasting
- greykite
Privacy / Compliance
- datagrail.io
- immuta
- privacera
- ethyca
- osano
https://github.com/jhuangtw/xg2xg

xg2xg: Google Internal to Open-Source/Cloud Mapping

What's inside xg2xg

Core Technology Mappings

Infrastructure Mappings

Storage Mappings

Services Mappings

1:1s and Check-ins

Meetings and Facilitation

Decision Making Frameworks

Understanding Self and Team

Career Conversations and Growth

Team and Code Health

Mentorship and Coaching

Hiring Distributed and Contract Engineers

Interviewing-as-a-Service and Assessment

Sourcing and Referrals

Diversity and Inclusion (D&I)

Recruiting and Executive Search

Leveling and Compensation

Distributed Frameworks

Warehouse

Data Lake

Change data capture / streaming

Data Versioning

OLAP

Streaming

Real-time/Document-search

Notebooks / Exploration

Labeling

Notebook Management

Orchestration

Dataflow/Transformation Managers

Unstructured/Semi-structured Data Prep

Data Quality Monitoring

Anomaly Detection as a Service

Event Data

A/B Testing

Behavioral Analytics

Feature Flagging

Authorization

Catalogue / Metadata

BI

ETL / Ingestion-as-a-service

Reverse-ETL

Sales Analytics

Timeseries Forecasting

Privacy / Compliance