[{"data":1,"prerenderedAt":313},["ShallowReactive",2],{"navigation":3,"page-\u002Ffoundations\u002Fthe-data-layer":88,"\u002Ffoundations\u002Fthe-data-layer-surround":307,"comments-\u002Ffoundations\u002Fthe-data-layer":312},[4],{"title":5,"path":6,"stem":7,"children":8,"page":87},"En","\u002Fen","en",[9,53],{"title":10,"path":11,"stem":12,"children":13,"icon":52},"CRM Analytics Foundations","\u002Fen\u002Ffoundations","en\u002F1.foundations\u002F1.index",[14,16,20,24,28,32,36,40,44,48],{"title":15,"path":11,"stem":12},"Welcome & Dev Org",{"title":17,"path":18,"stem":19},"Graded Quiz","\u002Fen\u002Ffoundations\u002Fquiz","en\u002F1.foundations\u002F10.quiz",{"title":21,"path":22,"stem":23},"What Is CRM Analytics?","\u002Fen\u002Ffoundations\u002Fwhat-is-crm-analytics","en\u002F1.foundations\u002F2.what-is-crm-analytics",{"title":25,"path":26,"stem":27},"Architecture","\u002Fen\u002Ffoundations\u002Farchitecture-and-data-flow","en\u002F1.foundations\u002F3.architecture-and-data-flow",{"title":29,"path":30,"stem":31},"The Data Layer","\u002Fen\u002Ffoundations\u002Fthe-data-layer","en\u002F1.foundations\u002F4.the-data-layer",{"title":33,"path":34,"stem":35},"The Design Layer","\u002Fen\u002Ffoundations\u002Fthe-design-layer","en\u002F1.foundations\u002F5.the-design-layer",{"title":37,"path":38,"stem":39},"The Intelligence Layer","\u002Fen\u002Ffoundations\u002Fthe-intelligence-layer","en\u002F1.foundations\u002F6.the-intelligence-layer",{"title":41,"path":42,"stem":43},"Hands-On Tour","\u002Fen\u002Ffoundations\u002Fhands-on-tour","en\u002F1.foundations\u002F7.hands-on-tour",{"title":45,"path":46,"stem":47},"Six Adoption Steps","\u002Fen\u002Ffoundations\u002Fsix-steps-and-interview-prep","en\u002F1.foundations\u002F8.six-steps-and-interview-prep",{"title":49,"path":50,"stem":51},"Interview Questions","\u002Fen\u002Ffoundations\u002Finterview-questions","en\u002F1.foundations\u002F9.interview-questions","i-lucide-compass",{"title":54,"path":55,"stem":56,"children":57,"icon":86},"Setup & User Provisioning","\u002Fen\u002Fsetup","en\u002F2.setup\u002F1.index",[58,60,64,68,72,76,80,83],{"title":59,"path":55,"stem":56},"Provisioning Users",{"title":61,"path":62,"stem":63},"Licenses & Permissions","\u002Fen\u002Fsetup\u002Flicenses-and-permission-sets","en\u002F2.setup\u002F2.licenses-and-permission-sets",{"title":65,"path":66,"stem":67},"Integration User","\u002Fen\u002Fsetup\u002Fthe-integration-user","en\u002F2.setup\u002F3.the-integration-user",{"title":69,"path":70,"stem":71},"Security User","\u002Fen\u002Fsetup\u002Fthe-security-user","en\u002F2.setup\u002F4.the-security-user",{"title":73,"path":74,"stem":75},"Analytics Settings","\u002Fen\u002Fsetup\u002Fanalytics-settings","en\u002F2.setup\u002F5.analytics-settings",{"title":77,"path":78,"stem":79},"Hands-On Access","\u002Fen\u002Fsetup\u002Fhands-on-assigning-access","en\u002F2.setup\u002F6.hands-on-assigning-access",{"title":17,"path":81,"stem":82},"\u002Fen\u002Fsetup\u002Fquiz","en\u002F2.setup\u002F7.quiz",{"title":49,"path":84,"stem":85},"\u002Fen\u002Fsetup\u002Finterview-questions","en\u002F2.setup\u002F8.interview-questions","i-lucide-settings-2",false,{"id":89,"title":90,"access":91,"body":92,"description":296,"extension":297,"interview":298,"links":298,"meta":299,"navigation":300,"passScore":298,"path":30,"quiz":298,"seo":301,"stem":31,"video":302,"__hash__":306},"docs\u002Fen\u002F1.foundations\u002F4.the-data-layer.md","The Data Layer: Sync, Recipes & Datasets","members",{"type":93,"value":94,"toc":286},"minimark",[95,99,116,121,132,139,155,167,171,174,188,206,213,217,224,231,234,253,257,268,272,275,279],[96,97,90],"h1",{"id":98},"the-data-layer-sync-recipes-datasets",[100,101,102,103,107,108,111,112,115],"p",{},"Everything impressive in CRM Analytics — snappy dashboards, instant filtering, machine-learning predictions — rests on a strong ",[104,105,106],"strong",{},"data layer",". This layer does two jobs: it ",[104,109,110],{},"stores"," your data efficiently and it ",[104,113,114],{},"prepares"," that data into an analysis-ready shape. Get comfortable here and the rest of the platform makes sense. This lesson is a members lesson because it is where \"using CRM Analytics\" turns into \"understanding CRM Analytics.\"",[117,118,120],"h2",{"id":119},"data-sync-the-staging-layer","Data Sync: the staging layer",[100,122,123,124,127,128,131],{},"Before you can transform data, you have to bring it in. That is the job of ",[104,125,126],{},"Data Sync",", sometimes called ",[104,129,130],{},"Connect",". Think of it as a staging area: it reaches out to your sources and pulls their data into CRM Analytics as small, individual datasets — one per object or table you sync.",[100,133,134,135,138],{},"For the ",[104,136,137],{},"local Salesforce connection",", Data Sync is especially smart:",[140,141,142,149],"ul",{},[143,144,145,148],"li",{},[104,146,147],{},"Incremental refresh"," — instead of reloading every record on every run, it fetches only what changed since last time. Faster syncs, lighter load.",[143,150,151,154],{},[104,152,153],{},"Filters"," — you can sync only the rows you actually need (for example, only opportunities from the last two years), keeping your staged data lean.",[156,157,159],"tip",{"icon":158},"i-lucide-database",[100,160,161,162,166],{},"Sync first, transform later. Data Sync's job is just to ",[163,164,165],"em",{},"land"," clean source copies quickly. The shaping happens in the next step.",[117,168,170],{"id":169},"preparing-data-dataflow-vs-recipes","Preparing data: Dataflow vs. Recipes",[100,172,173],{},"Once data is staged, you shape it — join tables, compute fields, aggregate, filter, bucket. CRM Analytics gives you two tools for this, and knowing the difference is a classic interview topic.",[100,175,176,179,180,183,184,187],{},[104,177,178],{},"The Dataflow editor"," is the original, ",[104,181,182],{},"legacy"," transformation engine. It is genuinely powerful and can express complex logic, but it is ",[104,185,186],{},"less user-friendly"," — a JSON-driven, node-based experience that takes some getting used to.",[100,189,190,193,194,197,198,201,202,205],{},[104,191,192],{},"Data Prep \u002F Recipes"," is the ",[104,195,196],{},"modern",", ",[104,199,200],{},"drag-and-drop"," experience. You build a visual pipeline of transformation nodes, preview results as you go, and generally move faster with less friction. Salesforce has been investing heavily here, and ",[104,203,204],{},"Recipes is steadily moving toward feature parity"," with the dataflow. For new work, Recipes is the recommended path; you will still encounter dataflows in older orgs.",[207,208,210],"note",{"icon":209},"i-lucide-workflow",[100,211,212],{},"Same goal, two tools: both produce datasets. The dataflow is the powerful old guard; recipes are the friendly, fast-improving future.",[117,214,216],{"id":215},"datasets-the-secret-sauce","Datasets: the secret sauce",[100,218,219,220,223],{},"The output of all this preparation is the ",[104,221,222],{},"dataset"," — and datasets are the real \"secret sauce\" of CRM Analytics.",[100,225,226,227,230],{},"A dataset is ",[104,228,229],{},"optimized columnar storage",". Unlike a traditional row-based transactional database (great for saving one record at a time), columnar storage is purpose-built for analytics: reading a few columns across millions of rows, filtering, and aggregating at lightning speed. This is precisely why CRM Analytics can filter a multi-million-row dashboard the instant you click, something a standard report struggles to match.",[100,232,233],{},"Key things to remember about datasets:",[140,235,236,243,250],{},[143,237,238,239,242],{},"They handle ",[104,240,241],{},"high volume"," gracefully.",[143,244,245,246,249],{},"They deliver ",[104,247,248],{},"fast query"," performance because of the columnar design.",[143,251,252],{},"They are the unit that dashboards, lenses, and stories all read from.",[117,254,256],{"id":255},"keeping-it-running-monitoring-data-jobs","Keeping it running: monitoring data jobs",[100,258,259,260,263,264,267],{},"A data layer is not \"set and forget.\" Syncs, dataflows, and recipes all run as ",[104,261,262],{},"data jobs",", and part of owning the data layer is ",[104,265,266],{},"monitoring"," those jobs — checking that they ran, how long they took, and whether any failed. CRM Analytics provides a monitor view for exactly this, so you can catch a broken sync before a stakeholder notices a stale dashboard.",[117,269,271],{"id":270},"putting-it-together","Putting it together",[100,273,274],{},"The data layer flow is simple to recite and worth memorizing:",[276,277],"lesson-steps",{":items":278},"[{\"title\":\"Data Sync \u002F Connect\",\"description\":\"Stage source data as small datasets, with incremental refresh and filters for the local Salesforce connection.\"},{\"title\":\"Transform\",\"description\":\"Shape and combine staged data with the legacy Dataflow or modern drag-and-drop Recipes.\"},{\"title\":\"Datasets\",\"description\":\"The result is optimized, high-volume, fast-query columnar storage — the platform's secret sauce.\"},{\"title\":\"Monitor\",\"description\":\"Watch data jobs to keep the whole pipeline healthy and catch failures early.\"}]",[100,280,281,282,285],{},"Master this and you have mastered the foundation of the platform. Next up: the ",[104,283,284],{},"design layer",", where those datasets finally become something people can see and explore — lenses, dashboards, and apps.",{"title":287,"searchDepth":288,"depth":289,"links":290},"",1,2,[291,292,293,294,295],{"id":119,"depth":289,"text":120},{"id":169,"depth":289,"text":170},{"id":215,"depth":289,"text":216},{"id":255,"depth":289,"text":256},{"id":270,"depth":289,"text":271},"Inside the CRM Analytics data layer: Data Sync staging, Dataflow vs. Data Prep recipes, and the optimized datasets that make queries fast at high volume.","md",null,{},{"title":29},{"title":90,"description":296},{"id":303,"start":304,"end":305},"aPwndqsmaGk",662,791,"M5uAEy714A3nXiVmQ5YpJLFKAbJgtvOAFOvwgcDDFMs",[308,310],{"title":25,"path":26,"stem":27,"description":309,"children":-1},"A simple map of CRM Analytics architecture: connectors, CSV upload, ETL\u002FAPI ingestion, datasets, live connections, output, and dedicated compute in Salesforce.",{"title":33,"path":34,"stem":35,"description":311,"children":-1},"The CRM Analytics design layer explained: lenses for quick exploration, dashboards for curated analytics, and apps that group assets and control sharing.",[],1783454181204]