Radar School All articles
Radar School

Why Multi-Sensor Fusion Is a Phrase That Often Does Not Work

Why Multi-Sensor Fusion Is a Phrase That Often Does Not Work

This article is mathematically aimed at counter-unmanned aerial systems (C-UAS) application. Radar, along with other sensors, could be a big asset in detection and tracking UAS (drones for example).

A note on tone before we begin. This piece is intentionally casual. Half technical article (EECS 965 Detection and Estimation Theory), half conversation with whoever has been thinking about the same problems we have. If you want the formal treatment, that is coming in a peer-reviewed paper. Today we want to walk you through how we actually think about this, with the same kind of asides Prof. Jim Stiles used to put in his lecture slides at KU. The man would put Homer Simpson in the middle of a Cramér-Rao derivation if the moment called for it, and we have never forgotten how much that helped the material stick. So here we go.

The Question Nobody Wants You to Ask

Most Counter-UAS tech sheets we have seen open with a sensor list. Radar. Camera. RF. Acoustic. Maybe a glossy spec table. The implicit promise is that with enough boxes on the system diagram, the drone problem is solved.

There is a question that punctures that promise immediately.

Given the sensors you have, with the noise floors they actually have, and the detection probabilities they actually have, what is the best position accuracy and the best classification reliability that any algorithm in the world can achieve from them? And does that ceiling actually clear your mission requirement?

That is a very different question than “which sensor should I buy.” And almost nobody in the commercial C-UAS space has a clean answer to it. The honest reason is that answering it requires the kind of estimation-theory machinery that lives in graduate radar courses and IEEE Transactions papers, not in product brochures.

This article is our attempt to bring a little of that theory into daylight. We are working on the formal publication. Today we want to share the reasoning behind it, casually, because the conclusions matter for anybody buying or building or evaluating these systems.

Why?

Most of the framework we are about to describe started, for both of us, in EECS 965 Detection and Estimation Theory at the University of Kansas, taught by Prof. Jim Stiles. We were classmates in that course and we have been thinking about these problems together ever since. Anybody who has sat in that classroom knows what we mean when we say his slides are the best. Cramér-Rao Bound on slide 10, Professor Shannon Blunt on slide 20, Professor Demarest next to del operators, and a large number of Homer Simpsons everywhere. Somehow the entire room understood Fisher information better because of it. He taught the Cramér-Rao Bound the right way. Not as a formula you memorize, but as a statement about the nature of information and what it permits.

Who is Homer Simpson? Check this out - https://en.wikipedia.org/wiki/Homer_Simpson

The cliché applies. We love it when a plan comes together. The A-Team had Hannibal saying that with a cigar. We get to say it when a Posterior Cramér-Rao recursion lines up with a Monte Carlo and confirms that a sensor suite we are evaluating has the headroom the customer needs. Different theater, same satisfaction.

“Multi-Sensor Fusion” Is Often a Phrase That Does No Work

“Multi-sensor fusion” usually means we have a few different sensors, and we combine their outputs somehow. That is fine as far as it goes. It says nothing about whether the combination is doing anything close to what physics allows.

Imagine a small low-cost quadcopter hovering at 500 meters. You have a 77 GHz (ish) millimeter-wave radar. At that range, against that target, your radar’s detection probability might be 0.85. Your electro-optical camera in daylight might be at 0.70. Your acoustic array is essentially napping at 500 meters because sound does not carry that far through ambient noise (unless you deployed an acoustic network). Your passive RF receiver is strong if the drone is chatting, but if the drone is fiber-tethered with no radio link at all, the RF receiver is staring at zero.

Now, the actual question. What is the best position accuracy any algorithm could possibly squeeze out of fusing those sensors? Not what your specific tracker does. What can any tracker do?

This is the question that the Cramér-Rao Bound was invented for.

Lets Start With Fisher Information

Before the bound, there is the concept of Fisher information. Prof. Fisher was Prof. Rao’s advisor. History on Statistics another day! or look up a few legends. Ronald Aylmer Fisher, Harald Cramér, and Calyampudi RadhaKrishna Rao.

Here is a simple version.

Imagine you are trying to figure out where something is, and you have a noisy measurement of it. The Fisher information of that measurement is, roughly, how much the measurement reacts when the target moves a little. If a small movement causes a big change in the measurement distribution, you have a sensitive sensor and you can pin down the target. If the target can move significantly and the measurement barely flinches, the sensor is more decorative than informational.

A radio dial analogy works well. If turning the dial a millimeter completely changes the station, the dial is informationally rich at that point. If you turn it an inch and nothing changes, you are in a dead zone. Fisher information formalizes that idea for the problem of estimating target state.

For a sensor with Gaussian noise, there is a clean recipe. Take how sensitive each measurement is to each component of the target state. Weight by how noisy each measurement is. Combine. You get a matrix, called the Fisher Information Matrix, that summarizes how much each part of the target state is observable through that one sensor. Big numbers in the position rows? You can localize. Zeros in the range row? You cannot tell how far away the target is from this sensor at all.

The Cramér-Rao Bound then says that the error covariance of any unbiased estimator is at least the inverse of the Fisher Information Matrix. There is a floor on how well you can estimate the target state, and the floor is set by the physics of the sensor and the geometry. No clever algorithm beats it. Maximum likelihood approaches it. Nothing goes below it.

This is Hannibal-level satisfying when you finally understand it. The universe has a built-in budget for how informative a noisy measurement can be, and the budget is computable.

The Detection Probability and Cramér-Rao Bound

Here is where the standard textbook treatment runs out of road for our problem.

The classical Cramér-Rao Bound assumes you always get a measurement. In real radar, you do not. At 500 meters against a low-cross-section drone, the radar might return nothing on 15 out of 100 scans. The camera in fog might miss frames. The acoustic array might be below threshold most of the time.

So we have to modulate the information. A sensor can only contribute to your estimate during the scans when it actually detects the target. If it detects 90% of the time, it contributes 90% of its theoretical Fisher Information Matrix on average. If it detects 0% of the time, it contributes nothing. Like that one friend who shows up to brunch when they feel like it. The average usefulness depends on attendance.

That gives a clean rule for combining sensors. The joint modulated Fisher Information Matrix is the sum of each sensor’s matrix, each one scaled by that sensor’s detection probability at the current target state. The Cramér-Rao Bound on the fused estimate is the inverse of that sum.

Three things drop out of this that are easy to miss until you write it down.

  1. Adding a sensor never hurts. Every contribution is non-negative. Adding any sensor to the suite tightens the floor on estimation error, even if the sensor is mediocre. The bound monotonically improves.

  2. A sensor with zero detection probability contributes exactly zero. Not small. Not negligible. Zero! A passive RF receiver against a fiber-tethered drone is the sensor that did not show up to brunch. It might as well not exist for that target class.

  3. The bound depends on the target geometry. It is not a single number for your system. It is a surface over the engagement space. At short range, with high detection probabilities, the bound is tight. At long range, as detections drop, the bound loosens. The performance you can claim depends on where the target is, not just on what sensors you have.

If Scientists Talk (Without Equations, Of Course)

Let us make this concrete. Single 77 GHz FMCW radar. Target is a small quadcopter at 400 meters range and 40 meters altitude, moving toward the sensor at about 5 meters per second. Drone cross section roughly 0.01 square meters, which at 77 GHz is roughly the radar reflectivity of a medium-sized bird like a pigeon. Question. What is the lower bound on position estimation accuracy?

Step one. What does the sensor measure? The radar gives back four things per scan. Distance to the target. The rate at which that distance is changing (Doppler). The two angles that locate the target in the sky (azimuth and elevation). Each is a function of the target’s three-dimensional position and three-dimensional velocity.

Step two. How noisy is each measurement? For an FMCW radar with 1 GHz sweep bandwidth and a 100 ms coherent processing interval, the measurement uncertainties at the detection-threshold operating point are roughly ten centimeters in range, twenty centimeters per second in range rate, and half a degree in each angle. These numbers come from the ambiguity function of the waveform, which sets the physical floor for what one coherent processing interval can resolve at a given signal-to-noise ratio. At higher SNR (closer in or against a brighter target), these uncertainties scale down with the square root of SNR. The Cramér-Rao Bound captures that scaling exactly.

Step three. How sensitive is each measurement to target motion? This is the derivative step. The range measurement reacts most strongly to motion along the line of sight. The azimuth angle reacts to lateral motion but is completely blind to motion directly toward or away from the sensor. Elevation reacts to vertical motion. The Doppler reacts to velocity components along the line of sight but is blind to transverse velocity. What comes out of this step is a table of sensitivities, one row per measurement, one column per target state component.

Step four. Combine sensitivity and noise into the Fisher Information Matrix. Weight each row by the inverse of its noise variance. Sum the contributions. You get a six-by-six matrix that summarizes everything this radar knows about the target’s state from one scan. The structure of this matrix has a nice geometric reading. Range contributes information along the line of sight. Angles contribute information perpendicular to the line of sight. Together, they cover all three spatial dimensions. This is why a single radar can localize in 3D from a single site, while a single camera, which only measures angles, cannot.

Step five. Detection probability. Using the radar equation with parameters representative of high-end commercial C-UAS radars (transmit power on the order of one watt, antenna gain around 25 dBi each on transmit and receive, coherent integration over a 100 ms dwell), the post-CPI signal-to-noise ratio at 400 meters against a 0.01 square meter target works out to around 23 decibels. For a fluctuating-target detector model, that maps to a detection probability of roughly 0.93 at a reasonable false alarm rate. A bare automotive-class chip at the same range against the same target would land much lower in SNR and much lower in Pd, which is exactly why dedicated C-UAS radars exist as a separate product category.

Step six. Modulate and invert. Multiply the Fisher Information Matrix by 0.93. Take its inverse, restricted to the position components. The square root of the trace of that block gives you the position root-mean-square error lower bound. At this geometry, the range component (along the line of sight) is on the order of a few centimeters, but the cross-range component (perpendicular to the line of sight) is much larger, because angular accuracy of around half a degree projects to a couple of meters at 400 meters range. The full 3D position RMSE bound from radar alone is therefore around 3 meters, dominated entirely by cross-range. The “radar gives you precise range and approximate angles” pattern that operators know intuitively falls out of the bound directly.

Step seven. Add a camera and watch the information accumulate. A high-resolution electro-optical camera at 400 meters might have angular noise of 0.02 degrees, which is much tighter than the radar’s half-degree angles. Detection probability around 0.78. The camera measures only the two angles, no range, so its Fisher Information Matrix has the same angular rows but a missing range row. By itself, the camera’s matrix is rank-deficient in the range direction. There is literally zero information about how far away the target is from angles measured at a single site. Together with the radar, the joint modulated matrix combines the radar’s range coverage with the camera’s tighter angular coverage. The cross-range component drops from 2 meters down to roughly 16 centimeters because the camera’s angular precision dominates the fused angle bound.

The 3D position RMSE bound is now around 22 centimeters, an order-of-magnitude improvement over radar alone. The radar carries the range. The camera refines the angles. Neither one alone gets you to 3D. And there it is, the plan coming together, A-Team theme playing softly in the background.

Classification Is a Separate Problem With Its Own Floor

Everything above is kinematics. Where is the target, how fast is it moving. The C-UAS operator also needs to know what the target is. Is it a drone or a Canada goose. Is it a consumer Mavic or a fiber-tethered FPV with no radio.

The classification problem has its own information-theoretic bound, completely separate from the localization bound. The relevant concept here is the Bhattacharyya distance between class-conditional distributions. Mouthful of a name. Yup! Another Indian. Statistics history another day! or look up Anil Kumar Bhattacharyya.

Picture it this way. Suppose you plotted the radar micro-Doppler signature of every drone you ever measured, and on top of that you plotted the same signature for every bird. If the two clouds of dots are well separated, the radar has high Bhattacharyya distance for the drone-versus-bird pair, and it is a useful classification sensor. If the clouds overlap heavily, the radar cannot tell them apart.

The result that matters is that when sensors are conditionally independent, those class-separation distances add across sensors. Each new sensor that distinguishes the classes at all reduces the classification error ceiling. The reductions compound. This is why even a modestly discriminative sensor is worth adding to the suite, as long as it sees something the others do not.

Now for the operationally striking part. Against a fiber-tethered RF-silent FPV drone, the passive RF receiver gives you zero classification information between the drone class and the bird class. The RF channel is closed. The receiver is napping. Done! Meanwhile the acoustic array, which is useless for localization at most engagement ranges, gives you strong classification information through the harmonic motor signature that rotorcraft have and birds do not. When RF goes silent, the acoustic array carries the majority of the classification information. That is not something you would conclude from a feature spreadsheet. It falls out of the framework directly.

We have heard people describe this kind of result as “fusion magic.” It is not magic. It is the bound math telling you which sensor is doing real work and which one is decorative against a particular threat. The same way Despicable Me’s Minions clearly serve different roles depending on the heist. Some carry the gold. Some just press the wrong button at the wrong time. You want the bound math to tell you which is which before you pay for either.

Why This Matters for 4cThreat

The reason we built our sensor architecture around the theory rather than around a feature list is precisely this. Without the information-theoretic framework, there is no principled way to know whether the suite you have assembled meets the operational requirement you have stated. You can tune your algorithm, gather field data, and report a performance number against a specific target on a specific day. But you cannot tell whether that number represents the best the physics allows, or whether you are well below the ceiling and a different algorithm would close the gap.

The bound gives you the ceiling. The algorithm tells you where you are. The gap between them tells you whether to invest in better algorithms or better hardware. That is a procurement decision you can actually defend, not a gut call dressed up in marketing language.

We are writing this up formally for a peer-reviewed publication. What is in this article is maybe one percent of the depth. A sketch of the first theorem, missing the tracking-over-time generalization, the full classification bound, the joint operational design surface, and the systematic sensor-subset optimization that lets you pick the cheapest suite that meets a mission specification. But the shape of the reasoning is the same throughout. Frame the problem as estimation. Compute the information-theoretic bound. Let the bound drive design.

To be clear, none of the individual pieces are new. The Cramér-Rao Bound has been in textbooks since the 1940s. The Posterior CRB for tracking was published by Tichavský and colleagues in 1998. The Bhattacharyya bound has been in the pattern recognition literature for decades. What is novel, and what we are formalizing, is the joint application of these tools to the specific problem of heterogeneous sensors, imperfect detection, and simultaneous classification-plus-localization that defines the modern C-UAS domain. That joint formulation, to our knowledge, does not exist in the peer-reviewed record.

Questions Worth Asking Your Vendor (or Yourself)

If you are interested in C-UAS at any level, we would encourage you to ask these of any system you are evaluating.

What is the claimed detection probability, and against what target cross section, at what range, in what weather? Detection probability is not a sensor property in isolation. It is a property of sensor, target, geometry, and threshold. A 98% detection probability number against a large calibration sphere at optimal range does not tell you what happens against a carbon-fiber FPV at 500 meters in clutter.

How does the claimed position accuracy compare to the theoretical floor? If the gap is small, the algorithm is doing real work. If the gap is large, either there is algorithmic headroom or the bound was never computed. Both are diagnostic. The second is also a credibility signal.

What is the published performance against RF-silent threats specifically? If the answer is identical to the RF-emitting case, somebody either has an unusually capable radar and optical stack, or the test set did not include the harder case.

What breaks when you remove one sensor? If pulling one sensor collapses performance, that is sensor dependence, not sensor fusion. Real fusion degrades gracefully because information is distributed across modalities.

These questions do not require knowing the Cramér-Rao Bound. But once the bound is in your hands, the answers become auditable. That is the whole point.

A note on the title. “Multi-sensor fusion” is the phrase, but the phrase by itself promises nothing. Without the math that says how much information each sensor actually adds, against which target, in which geometry, fusion is just a label on a sensor list. The bound is what turns the phrase into work.

If you work in detection and estimation theory, radar systems, or C-UAS and you want to compare notes, our inboxes are open from Fall 2026.

And yes. We love it when a plan comes together.

Authors. Hara Madhav Talasila, PhD and Gordon Ariho. Classmates in EECS 965, lab mates at KU, and now collaborators on the formal write-up.

#CounterUAS #DroneDefense #RadarSystems #SensorFusion #EstimationTheory #FisherInformation #4cThreat #CriticalInfrastructure #Defense #EECS #SignalProcessing

Originally on LinkedIn → Back to all articles Series DOI