• by gizmo on 11/2/2023, 11:25:40 PM

    DoorDash has about 35 million users, and there is zero interaction between users. The median user uses doordash maybe once a week. So 5 million sessions a day, all happening in the same 3 hour window. That's 2 million sessions per hour at peak times.

    How does DoorDash get to 1.2 million queries per second. 1.2mqps * 10000 seconds in 3 hours = 12 billion queries to process 5 million orders? That's wild. Is it all analytics? This is highly suspect. 35m users isn't nothing, but it isn't exactly Facebook scale either.

  • by xyst on 11/3/2023, 12:06:08 AM

    > About 1.2 million queries per second at daily peak hours.

    > About 2,300 total nodes spread across 300+ clusters.

    > About 1.9 petabytes of data on disk.

    > Close to 900 changefeeds.

    > Largest cluster is currently 280 TB in size (but has peaked above 600 TB), with a single table that is 122 TB.

    all of this yet my food still arrives cold af

    kidding aside, I wonder if DD has the same problems as Uber or Lyft except with food delivery. Each new "change feed" is a specific region, county/municipality, or city. Federal, state, and local laws all handled delicately.

  • by rickreynoldssf on 11/2/2023, 9:52:52 PM

    I'm not really seeing why DoorDash needs all their operational data in one monster clustered database. I would think its so much simpler to shard the data by region for operational queries and aggregate in the background for long-term storage.

  • by sean0- on 11/3/2023, 12:11:07 AM

    Ha! Amazing (didn’t know this was being written or put up).

    This is a summary of a recent conference talk:

    https://youtu.be/jCjrfpF64Kc?si=Gf-gp_ixX2V6Qz8V

    This was my team. We did and lived this. AMA.

  • by joshstrange on 11/2/2023, 11:33:57 PM

    Do you know what DoorDash doesn’t manage? A staging/test environment. All testing for API integrations is done in prod on shared account. The docs and the API endpoints themselves leave a lot to be desired as well.

  • by snihalani on 11/2/2023, 10:20:48 PM

    interesting. curious if anyone has benchmarked it relative to other dbs. like: https://benchmark.clickhouse.com/

  • by cebert on 11/2/2023, 10:37:30 PM

    This reads like a long form advertisement.