How to Turn CT and MRI Scans Into 3D Models for Surgical Planning

If your practice works with scans of any kind, CT, MRI, or ultrasound, you have almost certainly seen the polished 3D reconstructions that appear in surgical planning meetings, patient consultations, and research papers: a tumour rendered in colour against the organ around it, a heart rotated on screen, a bone measured to the millimetre. What most people assume is expensive proprietary software is very often a free tool called 3D Slicer.

3D Slicer has been built over more than two decades with funding from the United States National Institutes of Health and a global developer community. It is used by clinicians and researchers in over 100 countries to view scans, measure structures, outline organs and tumours, and turn flat image slices into interactive three-dimensional models. It costs nothing, runs on your own computer, and is powerful enough to sit at the centre of serious research and surgical-planning workflows.

For a practice owner, 3D Slicer is worth understanding for two reasons. First, it may already be quietly powering work your specialists or research partners do. Second, and more importantly for the future, it has become one of the main places where medical AI for imaging is built, tested, and validated. This guide explains what 3D Slicer is, where it fits, and one honest limitation you must understand before anyone uses it near a patient, all in plain language.

The Free Tool Behind Those 3D Models: 3D Slicer, in Plain English

At its simplest, 3D Slicer is a free program you install on a computer that lets a trained person do three things with medical scans:

1. Look at them properly. It reads the standard DICOM files that come off any CT, MRI, or ultrasound machine and displays them clearly, letting the user scroll through the slices, adjust contrast, and compare studies.

2. Measure and mark them. A user can measure distances, volumes, and angles, and can outline specific structures, an organ, a tumour, a blood vessel, a process called segmentation.

3. Turn them into 3D models. From a stack of two-dimensional slices, 3D Slicer builds an interactive three-dimensional reconstruction that can be rotated, sliced open, and even exported for 3D printing or surgical rehearsal.

Think of a CT scan as a loaf of bread that has been sliced. Each slice is a flat image. On their own, the slices are useful but hard to picture as a whole. 3D Slicer stacks the slices back into the loaf and lets you see, rotate, and measure the whole shape in three dimensions. That is the leap from "a stack of pictures" to "a model of the actual anatomy."

It supports every common imaging type, is extended by hundreds of specialised add-on modules (for cardiac imaging, radiation therapy planning, diffusion imaging, and much more), and is distributed under a permissive open-source licence that places no restrictions on legal use. It is genuinely free, with no per-seat fee and no subscription.

The One Limitation You Must Understand First

Before going any further, there is a critical point that separates responsible use of 3D Slicer from a compliance mistake, and it is stated plainly by the project itself.

3D Slicer is intended for research use. It is not FDA-cleared for routine clinical diagnosis.

This does not mean it is unsafe or low quality. It is used at the world's leading medical research institutions precisely because it is excellent. What it means is this: 3D Slicer has not been through the FDA's Software as a Medical Device clearance process, so it should not be the tool a clinician relies on to make a primary diagnostic call in routine care, in the way an FDA-cleared PACS viewer would be.

In practice, this shapes where 3D Slicer belongs:

• Appropriate: research, education, surgical planning and rehearsal, generating and reviewing 3D models, building and validating AI, creating training data, second-look analysis alongside cleared tools.
• Not appropriate on its own: the official diagnostic read of record in routine clinical care, which should run on FDA-cleared software.

We raise this first because it is exactly the kind of detail a vendor or an inexperienced consultant will gloss over. Knowing it up front protects your practice and lets you use a genuinely powerful free tool for the many things it is perfectly suited to. Getting the "build, buy, or partner" boundaries right is a recurring theme in our guide to how doctors are actually using AI in practice.

Why 3D Slicer Matters More Now: It Is Where Imaging AI Gets Built

For years, 3D Slicer was mainly a visualisation and measurement tool. What has changed, and why it belongs in any 2026 conversation about medical AI, is that it has become one of the primary workbenches where imaging AI is created and checked.

Here is why. Every AI model that reads a scan, whether it detects a nodule, measures a tumour, or segments an organ, has to be trained on examples where a human expert has already marked the correct answer. Someone has to outline thousands of tumours by hand so the AI can learn what a tumour looks like. That painstaking marking work, segmentation, is one of the things 3D Slicer does best, which is why it has become a standard tool for preparing the data that medical AI learns from.

It also connects directly to the AI ecosystem. 3D Slicer works alongside frameworks like MONAI, NVIDIA's free medical imaging AI toolkit, so that experts can use Slicer to create training labels, hand them to MONAI to train a model, and then use Slicer again to review how well the model performed. In modern imaging AI projects, Slicer is frequently the human-facing end of the pipeline.

For your practice, the implication is this: if you are ever told that a vendor's imaging AI was "trained and validated" on your type of scans, there is a good chance 3D Slicer was involved somewhere in that process. Understanding that helps you ask sharper questions about how a model was built and how thoroughly it was checked.

Where a Practice Actually Encounters 3D Slicer

Most practice owners will never install 3D Slicer themselves, and that is fine. You encounter its value in five realistic ways:

Surgical and procedure planning. Surgeons and specialists use Slicer to build a 3D model of a patient's specific anatomy before an operation, to plan the approach, rehearse difficult cases, and reduce time in theatre. Even if your practice does not do this in-house, your referral partners and the specialists you work with very likely do.

Patient communication. A three-dimensional model of a patient's own anatomy is a powerful consultation tool. Patients understand a rotating 3D image of their condition far better than a stack of grey slices, which improves consent conversations and confidence in a proposed treatment.

Research and publication. If your practice contributes to research, participates in trials, or publishes, 3D Slicer is very often the tool behind the imaging analysis and the figures.

Building and validating custom AI. If you ever pursue a custom imaging AI project, expect Slicer to be part of how the training data is prepared and the results are checked.

Second-look and quality review. Alongside your cleared diagnostic tools, Slicer supports detailed measurement, volume tracking over time, and quality review that adds value without replacing the diagnostic system of record.

3D Slicer and Compliance: What Practice Owners Need to Know

Because privacy is where practices carry the most risk, it is worth being precise about how 3D Slicer sits with HIPAA and comparable rules. The picture is genuinely favourable, with the research-use caveat already covered above.

It runs locally, so your data stays put. 3D Slicer is a desktop application. It installs and runs on a computer inside your own environment, and the scans it opens stay on that machine or your local network. It does not, by default, send patient images off to a cloud service to work. This is the same on-premises principle we recommend across clinical AI, discussed in our comparison of cloud AI versus local AI for medical practices. Because the images never leave your control, you avoid the third-party data flows that require Business Associate Agreements and create breach exposure.

Real scans still contain PHI. A DICOM file is not just an image. It carries embedded patient details: name, date of birth, medical record number, referring physician. So while 3D Slicer itself does not transmit anything, the files you load into it are protected health information and must be handled on secured, access-controlled machines like any other patient record. 3D Slicer includes tools to remove those identifiers (anonymisation) when images are being used for research, teaching, or sharing, which is an important workflow to use correctly.

GDPR and international use. The same logic applies for practices touching EU or UK patients. Because processing happens locally and identifiers can be stripped for non-care uses, 3D Slicer fits a privacy-preserving approach, provided the underlying real scans are handled under the usual safeguards.

The short version: 3D Slicer is a privacy-friendly architecture because it keeps data local, but the responsibility for securing the real patient files, and for anonymising them appropriately when they leave the care context, remains with you.

The Honest Comparison: Free Slicer vs Proprietary Imaging Software

The takeaway is not "free beats paid." It is that they do different jobs. A cleared proprietary viewer earns its cost as the diagnostic system of record. 3D Slicer earns its place everywhere else: planning, research, AI development, patient communication, and advanced analysis, all at no licence cost.

Getting Value From 3D Slicer: A Practical Path

If your practice wants to benefit from 3D Slicer, you do not start by downloading software. You start by deciding what you are trying to achieve, because 3D Slicer is a capable platform, not a turnkey product, and it needs a skilled operator to deliver clinical value safely.

This is where a common and expensive mistake shows up. Powerful free tools tempt practices to assume that "free software" means "no cost project." It does not. The software is free; the expertise to use it well, and to integrate it safely with your existing systems, is where the real work lies. Across our client engagements, the projects that struggle are the ones where a capable tool was handed to someone without the technical fluency to specify exactly what it should do and how it should connect to everything else. The projects that succeed have someone genuinely fluent in both the clinical goal and the technical build steering the work.

A sensible path looks like this:

1. Define the specific goal. Surgical planning models? Preparing data for a custom AI project? Research analysis? Patient-facing 3D visualisations? Each has different requirements and a different definition of success.

2. Confirm the data path and privacy setup. Where do the scans come from, how do they get into Slicer securely, and how are they anonymised when used outside direct care? This is settled before any images are touched.

3. Put a skilled operator on it. Whether that is a specialist on your team, a research partner, or a technical partner like ValueStreamAI, someone who knows both the imaging goal and the tooling needs to own the workflow.

4. Keep the diagnostic system of record separate. Slicer supports and enhances your imaging work; it does not replace your cleared diagnostic software. Keeping that boundary clear protects both patients and the practice.

For imaging AI projects specifically, this workflow connects directly to the broader deployment discipline in our AI deployment checklist for medical practices.

Open Source vs. Commercial: What Are the Paid Alternatives?

3D Slicer is not the only imaging and segmentation platform available; it competes with well-established commercial software used across hospitals and device companies. The clearest commercial benchmark is Materialise Mimics, widely regarded as the commercial standard for anatomical segmentation, surgical planning, and 3D-printing preparation, used by hospital labs, academic centres, and orthopaedic and cardiovascular device makers. Brainlab offers a comparable commercial suite, including automated cranial surgical-planning tools.

Pricing for these platforms is not published; both require a sales conversation, with license options spanning evaluation, annual, and perpetual terms. User reports describe commercial platforms like Mimics as expensive, commonly running into the tens of thousands of dollars per year, against 3D Slicer's zero license cost.

The decision is not simply price versus free. Commercial platforms like Mimics carry regulatory clearances for specific clinical workflows, such as designing a patient-specific surgical guide for manufacture, that 3D Slicer, a research-use tool, does not carry. If your use case is genuinely clinical device manufacturing, a cleared commercial platform is often not optional. If your use case is research, internal visualisation, surgical rehearsal, or building and testing an AI imaging model before it goes anywhere near a cleared product, 3D Slicer gives you the same underlying segmentation and 3D reconstruction capability for no license cost, provided you stay honestly within its research-use boundary.

Frequently Asked Questions

What is 3D Slicer used for in simple terms?

3D Slicer is a free program that lets a trained person view medical scans (CT, MRI, ultrasound), measure structures in them, outline organs or tumours, and turn the flat image slices into interactive 3D models. It is used for surgical planning, research, patient education, and increasingly for building and checking medical AI. It has been developed over more than 20 years with US National Institutes of Health funding and is used in over 100 countries.

Is 3D Slicer really free?

Yes, completely. 3D Slicer is open-source software distributed under a permissive licence, with no purchase price, no per-seat fee, and no subscription. The costs in a real project come from the expertise needed to use it well and integrate it safely with your systems, not from the software itself.

Can I use 3D Slicer to diagnose patients?

Not as your official diagnostic tool. 3D Slicer is intended for research use and is not FDA-cleared for routine clinical diagnosis, so the diagnostic read of record should run on FDA-cleared software. 3D Slicer is excellent and appropriate for research, surgical planning, education, AI development, and second-look analysis alongside your cleared tools, but it should not replace cleared diagnostic software in routine care.

Is 3D Slicer HIPAA compliant?

3D Slicer runs locally on your own computer and does not, by default, send patient scans to any outside service, which is a privacy-friendly design. However, the real scan files you load into it are protected health information and must be kept on secured, access-controlled machines like any other patient record. 3D Slicer also includes tools to anonymise images when they are used for research or teaching. Compliance depends on how your practice handles the underlying files, not on the software transmitting data, because it does not.

How does 3D Slicer relate to AI?

3D Slicer has become one of the main tools used to build and validate medical imaging AI. Training an AI to read scans requires experts to first mark the correct answers on many images, and that marking (segmentation) is something Slicer does very well. It also connects to AI frameworks like MONAI, so experts use Slicer to prepare training data, train a model elsewhere, and then use Slicer again to review the results.

Do I need technical staff to use 3D Slicer?

Yes, to get real value safely. 3D Slicer is a powerful platform rather than a simple app, so it needs a skilled operator: a specialist, a research partner, or a technical partner who understands both the clinical goal and how to connect the tool to your systems securely. Most practice owners never operate it directly; they benefit from the work a skilled person does with it.

The Bottom Line for Your Practice

3D Slicer is one of the clearest examples of a broader truth in healthcare technology: some of the most capable tools in the world are free, open, and already trusted by the leading institutions in medicine. For viewing scans in depth, building 3D models, planning procedures, communicating with patients, and developing and validating imaging AI, 3D Slicer delivers research-grade capability at zero licence cost.

The two things to hold onto are the honest limits and the honest requirements. It is for research and planning, not the official diagnostic read of record, and it needs a skilled operator to deliver value safely. Get those two things right and you have a genuinely powerful, privacy-friendly platform working for your practice for free.

If you are exploring imaging workflows, 3D models, or custom imaging AI, and want it done safely and integrated properly with your systems, ValueStreamAI's healthcare team can help you scope and build it. Start with our AI for Medical Practices hub, see how browser-based imaging fits together in our OHIF Viewer guide, or get in touch to talk through your imaging goals.

The capability is free and world-class. The value comes from using it wisely, and within the right limits.