Quick Verdict: Federated learning is a training pattern that keeps raw records at each site and ships model updates; a de-identified centralized dataset is a training pattern that moves records after a de-identification process and trains in one place. Federated learning reduces bulk PHI movement. De-identified centralization reduces multi-site GPU and orchestration tax. Neither is guaranteed HIPAA compliant by architecture alone.
Choose from the residual risk you can defend: re-identification of a “de-identified” extract, or leakage and capture of gradients and checkpoints at the edge. Healthcare AI programs stall when legal hears “federated” and stops reading the update path, or hears “de-identified” and stops reading the expert-determination file.
Federated learning vs de-identified centralization

Both patterns can be HIPAA-ready in design and still fail in operations. The table is the decision, not a winner.
| Dimension |
Federated learning |
De-identified centralized dataset |
| What moves |
Gradients, weights, or aggregated updates |
Records after de-identification or limited data set rules |
| Where GPUs sit |
At each hospital or in a site-adjacent enclave |
In one training environment the sponsor controls |
| Ops tax |
Per-site drivers, identity, and failed rounds |
One cluster, plus the de-identification pipeline |
| Main residual risk |
Update inversion, site dropout, uneven labels |
Re-identification, over-broad extracts, copies that linger |
| Audit artifact |
Round logs, site allow-lists, update checksums |
Determination method, data map, deletion evidence |
When federated learning is the better healthcare fit
Federated learning wins when sites will not release even de-identified extracts, or when counsel judges that creating a central corpus is the larger incident. Imaging consortia and multi-hospital quality models are the usual stories. The infrastructure requirement is real: each site needs GPU capacity, a controlled outbound path for updates, and someone who can restart a round when a PACS-adjacent node dies.
Do not treat federation as a HIPAA exemption. Updates can carry signal about rare patients. Secure aggregation, site-level differential privacy, and a ban on raw example export are design choices, not defaults. If a vendor cannot show what a site admin can dump from the client, you have a new PHI store with extra steps.
Healthcare AI infrastructure still needs a residency and tenancy story for the aggregator and for any “helper” GPU that the sponsor runs. OneSource Cloud’s dedicated U.S. environments are a fit for that central coordinator when sites refuse a public multitenant home for aggregated weights. They do not remove the need for site BAAs and IRB review where those apply.
When a de-identified central dataset is the cleaner plan
Centralization wins when you can defend the de-identification method, limit the extract, and train faster on one well-run cluster. Many clinical NLP and tabular risk models are in this bucket. The GPU plan is simpler. The legal plan is not. Expert determination, Safe Harbor elements, and “we dropped names” are not interchangeable. Residual risk remains, especially with rich notes, images, and dates.
The operational failure is copy sprawl. A de-identified warehouse that is snapshotted into notebooks, vendor sandboxes, and a data-science laptop is a centralized dataset in name only. Write deletion and retention before the first fine-tune. If you cannot delete an extract from every GPU scratch disk, you did not de-identify. You delayed the incident.
Private AI infrastructure is the usual home for that single training environment: dedicated GPUs, a short operator list, and U.S. residency for the corpus you decided you could move. AI storage architecture must keep the extract, the checkpoints, and the evaluation labels on a path you can inventory.
Evidence both patterns owe an auditor
Pick a pattern, then collect evidence that matches it.
- A data-flow diagram that names what leaves the EHR or PACS and what never does.
- For federation: site inventory, round authentication, and a failed-site protocol.
- For centralization: de-identification method, who signed it, and extract scope.
- GPU and backup locations for weights, updates, and any cached batches.
- A revoke or stop-training drill: can you halt a round or delete an extract on a clock.
If the health system cannot staff per-site GPU operations, federation will fail for operational reasons even when the legal theory is sound. That is a managed AI infrastructure problem at the coordinator, and a staffing problem at the edge. Do not paper over missing site engineers with a federated logo.
FAQ
Does federated learning satisfy HIPAA requirements?
No architecture “satisfies HIPAA” by itself. HIPAA-ready posture still depends on administrative safeguards, a defined PHI path, access control, and contracts such as a BAA where one applies. Federated learning can reduce bulk data movement. It does not make a platform guaranteed HIPAA compliant, and it does not automatically treat model updates as non-PHI in every fact pattern.
What GPUs does each hospital need for federated learning?
Enough to run the local step on the agreed model and batch, plus headroom for failed retries. A vision model and a tabular model are different site bills. There is no official hospital GPU SKU. Size the local job, then add monitoring so a dark site does not silently drop out of a round and bias the global model.
Is de-identified data free to train on anywhere?
No. De-identification reduces identifiers. It does not erase contracts, IRB conditions, state rules, or residual re-identification risk. A central GPU cloud in the wrong jurisdiction, or a vendor that sub-processes copies, can still be the wrong destination. Map the extract as if it still deserves a residency decision.
Can we combine both patterns?
Yes. Some programs federate across systems, then train a second stage on a narrower de-identified cohort the sponsor is allowed to hold. That hybrid only helps if each hop has its own evidence. Two incomplete stories do not add up to one complete control.
When should a health system refuse federation?
Refuse it when sites cannot run GPUs safely, when the vendor client can export examples, or when clinicians will not accept a model that no one can replay on a held-out local set. A simpler de-identified central project with a tight extract is often the more honest HIPAA-ready design in those conditions.
Summary
Federated learning vs de-identified centralization is a data-movement and residual-risk decision. Federation keeps records home and spends operations at the edge. Centralization spends legal effort on the extract and trains on one cluster. Neither is a HIPAA guarantee. If you need a dedicated U.S. home for the coordinator or the extract, review OneSource Cloud healthcare AI infrastructure after the data path is written down.