WO2009039161A2 - Systems and methods for transparency mapping using multipath signals - Google Patents

Systems and methods for transparency mapping using multipath signals Download PDF

Info

Publication number
WO2009039161A2
WO2009039161A2 PCT/US2008/076652 US2008076652W WO2009039161A2 WO 2009039161 A2 WO2009039161 A2 WO 2009039161A2 US 2008076652 W US2008076652 W US 2008076652W WO 2009039161 A2 WO2009039161 A2 WO 2009039161A2
Authority
WO
WIPO (PCT)
Prior art keywords
signal
multipath
receiver
signals
wireless
Prior art date
Application number
PCT/US2008/076652
Other languages
French (fr)
Other versions
WO2009039161A3 (en
Inventor
Donald E. Gustafson
John M Elwell
J. Arnold Soltz
Original Assignee
The Charles Stark Draper Laboratory, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Charles Stark Draper Laboratory, Inc. filed Critical The Charles Stark Draper Laboratory, Inc.
Publication of WO2009039161A2 publication Critical patent/WO2009039161A2/en
Publication of WO2009039161A3 publication Critical patent/WO2009039161A3/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/003Bistatic radar systems; Multistatic radar systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13Receivers
    • G01S19/14Receivers specially adapted for specific applications
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13Receivers
    • G01S19/22Multipath-related issues
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/38Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
    • G01S19/39Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system the satellite radio beacon positioning system transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO

Definitions

  • the present invention relates to mapping techniques, and more specifically to systems and methods for transparency mapping using multipath signals, such as remote interior and exterior three-dimensional transparency mapping of urban environments and building structures.
  • mapping techniques an observer (or his equipment) typically has to have a direct line of sight to an object to be mapped. If a portion of the object is out of sight, it may not be represented in a final map generated with the conventional techniques. This is true for existing mapping techniques such as land survey (with total stations), photo- mapping, photo grammetry, and remote sensing methods.
  • RF signals radio-frequency signals
  • microwave signals microwave signals
  • TOA time of arrival
  • one or more receivers may move across an area of interest and simultaneously detect signals from one or more sources. Based on the detected signals, the receivers' coordinates at different locations in the area may be calculated and synthesized into a map. Again, the receiver or tag must typically have a direct line of sight to the signal source(s) in order to accurately determine its own location. In a cluttered environment, such as an urban canyon or an enclosed structure, the receiver or tag may lose direct sight of signals, making it difficult to use direct-path signals for mapping. In this approach, the reflected signals are typically treated as unwanted noise.
  • FIG. 1 illustrates exterior mapping for an exemplary urban environment cluttered with Buildings A, B and C.
  • TCl and TC2 are two externally located RF transceivers, which may be fixed or mobile transceiver devices. As illustrated in FIG. 1, it may be difficult to employ TCl and TC2 to map Building C based on existing mapping techniques.
  • the transceivers TCl and TC2 may have a difficult time gaining an unobstructed sight of Building C. Thus, it is difficult for either TCl or TC2 to detect any RF signal reflected by Building C. In addition, RF signals from TCl and TC2 may be reflected one or more times by Buildings A and B (or other objects) before reaching Building C. Therefore, it is also difficult for RF receivers or transponding devices placed on, near or inside Building C to detect direct-path RF signals from TCl or TC2. In these circumstances, the existing mapping approaches would be incapable of mapping the exterior or interior of Building C, because those approaches either cannot fully exploit geometric information in multipath signals or simply discard multipath signals as unwanted noise. Signals reflecting from the interior surfaces of the building structures are even more difficult to incorporate into the overall mapping process for the same reasons.
  • the present invention relates to systems and methods for mapping a cluttered environment, such as an urban canyon, or an enclosed structure, such as a building.
  • the structure-penetrating capability of many RF signals can provide information about interior surface distances as well as building exterior surface distances.
  • the exemplary systems and methods described herein recognize that substantial information is available in multipath signals even when a direct-path signal is absent or undetected.
  • One object of the invention is to use radio frequency (RF) signals or other wireless signals to map a cluttered exterior or interior environment, wherein multipath signals may be analyzed to identify objects or surfaces not in direct line of sight to a signal source or a receiver.
  • RF radio frequency
  • embodiments of the invention feature a method for mapping a structure.
  • the method may include: detecting, at a receiver, a first wireless signal transmitted directly from a satellite; deriving, from the first wireless signal, a location of the satellite; detecting, at the receiver, a second wireless signal transmitted by the satellite and reflected by a structure; determining a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal; and mapping at least one reflection point associated with the structure.
  • the mapping may be based on the TDOA, a location of the receiver, and the location of the satellite.
  • embodiments of the invention feature a system for mapping a structure.
  • the system may include a receiver at a known location and one or more signal processing elements operatively coupled to the receiver.
  • the receiver and the signal processing elements may be configured to: (i) detect a first wireless signal transmitted directly from a satellite, (ii) derive, from the first wireless signal, a location of the satellite, (iii) detect a second wireless signal transmitted by the satellite and reflected by a structure, (iv) determine a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal, and (v) map at least one reflection point associated with the structure.
  • the mapping may be based on the TDOA, the location of the receiver, and the location of the satellite.
  • the receiver and the signal processing elements are further configured to derive, from the first wireless signal, a code sequence and a data message.
  • the receiver and the signal processing elements may also be configured to perform data wiping and coherent integration on the second wireless signal before determining the TDOA.
  • the receiver and the signal processing elements are configured to: (i) detect a signal having the first wireless signal and the second wireless signal mixed together; (ii) synthesize a replica of the detected signal by varying a first delay applied to the code sequence and mixing the resulting delayed code sequence with the code sequence until the resulting mixed code sequence matches the detected signal; and (iii) correlate the replica with the detected signal by varying a second delay applied to the replica until a correlation peak occurs between the delayed replica and the detected signal.
  • a plurality of first wireless signals and a plurality of second wireless signals both originating from one or more satellites may be detected, and the receiver and the signal processing elements may be further configured to (i) isolate, from the pluralities of wireless signals, a subset of wireless signals that originate from a same satellite and (ii) identify, from the subset of wireless signals, a direct path signal and at least one corresponding multipath signal that has reflected off of the structure.
  • the receiver and the signal processing elements may be further configured to determine a delay between the at least one corresponding multipath signal and the direct path signal.
  • embodiments of the invention feature another method for mapping a structure.
  • the method includes detecting a plurality of wireless signals that comprise at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection.
  • the plurality of wireless signals may be received from one or more sources and be detected with at least one receiver.
  • the method may also include analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal.
  • the method may include generating a map of at least the portion of the structure based on the estimated reflection points.
  • embodiments of the invention feature another system for mapping a structure.
  • the system includes at least one receiver for detecting a plurality of wireless signals originating from one or more sources.
  • the plurality of wireless signals include at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection.
  • the system may also include a processor, associated with the at least one receiver, for i) analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal and ii) generating a map of at least the portion of the structure based on the estimated reflection points.
  • the one or more sources may include, for example, one or more mobile transmitters (such as satellites moving in space), or at least two transmitters at known terrestrial locations.
  • the at least one receiver may move along a known trajectory within or near the structure, or it may move along an unknown trajectory within or near the structure and the system may be configured to track a location of the receiver. Tracking the location of the receiver and generating the map may take place at substantially the same time and in recursive steps.
  • the system also includes a Rake filter for processing a multipath signal in order to correlate the multipath signal with a corresponding direct path signal.
  • the processor may be configured to (i) determine a time delay between the multipath signal and the corresponding direct path signal and (ii) estimate one or more parameters associated with a multipath delay model.
  • the receiver is configured to assign one of the plurality of wireless signals to a corresponding signal path.
  • the processor may be further configured to distinguish the at least one multipath signal from a corresponding direct-path signal, to associate the at least one multipath signal with a corresponding direct- path signal, to iteratively estimate one or more multipath parameters associated with a multipath delay model, to distinguish single-reflection multipath signals from multiple- reflection multipath signals, to identify one or more true reflection surfaces responsible for producing the at least one multipath signal based on a statistical inference, and/or to eliminate one or more erroneous mapping points that result from a proximity effect.
  • the one or more multipath parameters for a multipath signal may include an angle-of-arrival from a last reflection experienced by the multipath signal.
  • generating the map may be based on both direct-path signals and multipath signals in the plurality of wireless signals.
  • FIG. 1 illustrates exterior mapping for an exemplary urban environment cluttered with Buildings A, B and C.
  • FIGs. 2A-C illustrate the geometry associated with one or more specular reflections in accordance with embodiments of the present invention.
  • FIG. 3 shows a flow chart illustrating an exemplary method for mapping based on multipath signals in accordance with an embodiment of the present invention.
  • FIG. 4 shows a process flow diagram illustrating an exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention.
  • FIGs. 5A-C show a floor plan of a building to illustrate one exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention.
  • FIG. 6 shows a floor plan of a building to illustrate exemplary mapping simulation results using multipath signals in accordance with an embodiment of the present invention.
  • FIG. 7 illustrates a system for mapping using multipath signals in accordance with an embodiment of the present invention.
  • FIG. 8 illustrates the structural geometry for enhancing satellite-based signals through data wiping for transparency mapping in accordance with an embodiment of the present invention.
  • FIG. 9 shows a block diagram illustrating an exemplary system for satellite-based transparency mapping in accordance with a data wiping embodiment of the present invention.
  • FIG. 10 shows a block diagram illustrating an exemplary multipath signal resolution method for satellite-based transparency mapping in accordance with an embodiment of the present invention.
  • FIG. 11 shows exemplary waveforms for signal resolution, PRN generation, and signal autocorrelation processes in accordance with an embodiment of the present invention.
  • FIG. A-I is another depiction of the geometry associated with a single specular reflection.
  • FIG. A-2 is another depiction of the geometry for two consecutive specular reflections.
  • embodiments of the present invention provide signal detection and processing techniques for indoor or transparency mapping applications. Rather than treating multipath signals as noise and attempting to mitigate multipath-induced errors, these techniques decode and exploit geometric information within multipath signals.
  • Embodiments of the present invention rely on well-established wireless signal transmission and receiving means to perform two-dimensional (2-D) and/or three-dimensional (3-D) mapping of cluttered outdoor and/or indoor environments.
  • one or more signal sources may be configured to transmit signals at known locations within or near an indoor or outdoor environment, while one or more receivers (e.g., detectors or transponding tags) may receive the resultant wireless signals within or near the environment.
  • the signal sources may be transmitters at fixed or variable locations within or near a building.
  • the receivers may be moving along a certain trajectory or be in a fixed position inside or outside the building.
  • Wireless signals received by a receiver may include both direct-path and indirect path (i.e., multipath, reflected) signals.
  • the multipath time-of-arrival or time-of-flight measurements are processed with a parametric model of indirect path length (or a multipath delay model) which contains angle - of-arrival as well as distance information.
  • the parametric model is developed by ray-tracing one or multiple reflective paths and is based on the geometry of ideal specular reflections. With the parametric model, estimated locations of the last reflection points are calculated.
  • True RF reflection surfaces can be established by statistically distinguishing single- reflection paths from multiple reflection paths.
  • the estimated reflection points and facets, as well as a priori information e.g., partial map), if any, can then be synthesized to provide geometric details of a cluttered environment.
  • the direct-path time-of-flight measurement is useful for establishing a current position of the receiver and to initialize multipath parameters.
  • Embodiments of the invention have potentially important commercial and military applications. These include, for example: (1) providing real-time indoor infrastructure information to first responders (e.g., policemen, firemen, and antiterrorist personnel) when maps may not exist or may have changed due to fire/explosions, etc.; and (2) efficient and inexpensive real-time mapping of warehouses, hospitals, etc. (including updating of current maps to address recent movement of significant objects such as large equipment, storage cabinets, etc.). In both scenarios, the indoor infrastructure or layout may have recently changed, rendering current maps obsolete; in this case, the real-time capability of the exemplary embodiments described herein allows timely updating of the maps.
  • one or more Rake filters are used to isolate a direct-path signal and its corresponding multipath signals.
  • time delay measurements of the direct and indirect multipath signals are processed using one or more of data association, initialization, parameter estimation, and tracking filters.
  • a data association algorithm may be used to enhance tracking of intermittent direct and indirect path measurements.
  • a particle filter is used to reduce the initial receiver position uncertainty to a region where an extended Kalman filter can be used for both indirect path parameter estimation and tracking.
  • dead-reckoning sensors or other navigation aids are used to slow error growth in measurements or to aid in the data association process.
  • FIGs. 2A-C illustrate the geometry associated with one or more specular reflections in accordance with embodiments of the present invention.
  • a wireless signal may be transmitted initially from a source s and experience multiple specular reflections before being detected by a receiver r.
  • the derivation of a multipath delay model may begin by assuming ideal specular reflection from a single planar surface.
  • C 1 is the scalar satisfying , such that r p is any point in the reflecting plane; and which represents the transformation (or reflection) matrix associated with the reflection plane (and where / is the identity matrix).
  • the four multipath parameters w At) i.e., a vector including three parameters
  • ⁇ (t) i.e., a single sealer parameter
  • These multipath parameter estimates can subsequently be used to track r(t) using indirect path measurements when other measurements of r(t) are unavailable (for example, when the direct path is lost). Since r(t) , w (t) and ⁇ (t) are random variables and measurement of ⁇ (t) is subject to error, a nonlinear filter may be used to accurately track tag location r(t) .
  • FIG. 2C presents the generalized three-dimensional multipath geometry for two specular reflections.
  • the geometry is similar to that illustrated in FIG. 2B, with the inclusion of a second reflecting surface defined by a unit vector u 2 and a scalar value c 2 .
  • Equation (I) which is of the same form as the one reflection case (i.e., Equation (I)).
  • Equations (1), (I)* and (2) are in the form of a measurement equation that can be used by an appropriate filter (e.g., an extended Kalman filter, a nonlinear filter, a particle filter) to simultaneously estimate the receiver position r and the four multipath parameters
  • an appropriate filter e.g., an extended Kalman filter, a nonlinear filter, a particle filter
  • the single-reflection and double-reflection cases may be generalized to formulate an expression for indirect path length as a function of receiver location and four parameters for any number of specular reflections. For n reflections, the
  • ⁇ On is the scalar g oeometry-dependent offset. Since w n can be expressed as a function of two angles, there are only three independent parameters to be estimated.
  • the mathematical framework as detailed above and in Appendix A is useful for both navigation (or tracking of receiver) and mapping applications.
  • the last reflection point (or facet) for each multipath signal may be calculated.
  • Those reflection points (or facets) may then be synthesized to map a structure and/or objects responsible for generating the multipath signals.
  • Secondary (deeper) facets may be determined by bootstrapping from last- reflection facets based on two-reflection and ⁇ -reflection models described below.
  • FIG. 3 is a flow chart of an exemplary processing method 300 for mapping based on a multipath delay model in accordance with an embodiment of the present invention.
  • one or more receivers may be positioned at known or determinable location(s) in relation to a structure or object of interest.
  • the structure or object to be mapped may be a building or a group of buildings (e.g., a building complex).
  • a single receiver such as a transponding tag may be placed inside the building sequentially at a number of known locations.
  • the single receiver may be moving along a known trajectory within the building.
  • two or more receivers may be placed at fixed known locations inside and/or outside the building.
  • wireless signals that originated from one or more sources may be detected.
  • the one or more sources may also have known or determinable locations.
  • the one or more sources may be either fixed or moving.
  • the sources may include RF transceivers carried by manned or unmanned aerial vehicles or satellites.
  • the sources may be wireless signal transmitters at fixed locations near the building to be mapped.
  • each signal source transmits wireless signals that can be reliably associated with that source or distinguished from other sources. Therefore, it may be desirable to encode wireless signals from different sources with distinguishable data, patterns and/or waveform shapes.
  • the wireless signals detected in step 304 may include both direct-path and multipath signals that are mixed together.
  • the detected signals may be processed and/or filtered to distinguish and associate the direct-path and multipath signals. That is, for it to be useful, each multipath component of the detected signal should be isolated or identified and then matched up with its corresponding direct-path signal. Part of the goal is to determine indirect path lengths (or multipath delays) from which geometric information of the building can be derived.
  • specular points responsible for producing the multipath signals may be calculated based on a multipath delay model.
  • the multipath delay model may be developed on the assumption that multipath signals result from ideal specular reflections only, as shown herein and in Appendix A.
  • the location of a specular point (e.g., last reflection) is just one set of variables in the multipath delay model to be solved.
  • the specular point may be solved for each individual instance of multipath signals.
  • the specular points calculated in step 308 may be synthesized and filtered to generate a map of the structure of interest.
  • the specular points calculated or estimated with the multipath delay model may contain false positives (i.e., extraneous map points) due to imperfection or inaccuracies in signal processing and/or mathematical assumptions.
  • a statistical inference method may be used to distinguish true facets (typically associated with single-reflection paths) from false reflection points (typically associated with multiple-reflection paths). It has been discovered that estimated points associated with a single reflection tend to cluster along the true RF reflection surfaces (facets), while estimated points associated with multiple reflections tend to map into large, poorly defined, clusters. This phenomenon allows the single-reflection paths and true reflection points to be discriminated from the multiple-reflection paths and false reflection points.
  • certain known information about the structure may be used to enhance the signal processing and map generation.
  • a partial map of the building of interest may be available and can be useful for enhancing or correcting the mapping results. It may also be hypothesized that most of the building walls are substantially vertical and the floors/ceilings are essentially horizontal. If it is known that a portion of the building has changed recently (e.g., due to fire or explosion), less of a weight may be placed on a prior map or floor plan of that portion.
  • the signal received at a node after reception and retransmission from the tag may be modeled as:
  • z(t) is the transmitted signal
  • a t (t) is the complex attenuation factor
  • ⁇ t (t) is the path delay
  • n(t) is noise
  • m is the number of indirect paths
  • ⁇ d is the processing delay within the tag, which is assumed to be known.
  • the tag state vector at time t will be denoted by x t .
  • x t contains the tag position r t .
  • the tag dynamics may be modeled using a linear discrete-time equation:
  • ⁇ t t _ 1 is the state transition matrix
  • B is the control influence matrix
  • b t is a known control
  • T t t _ 1 is the noise influence matrix
  • q t is zero-mean discrete white Gaussian process noise with covariance matrix Q t , and is independent of x t and w t .
  • ⁇ t t _ 1 , B t t _ 1 , and ⁇ t t _ 1 are known, and the initial state x 0 is Gaussian with mean x 0 and covariance matrix F 0 , thus a Gauss-Markov process.
  • Time delays ⁇ , (t) have been converted into distances using a known signal propagation velocity and a single indirect path is considered.
  • p is the specular point on the i th plane
  • d 1 is the distance from the source to p 1
  • ⁇ d i ;i 2,3
  • m ⁇ is the distance from p i-1 to p 1
  • d m+1 is the distance from p m to r
  • W 1 is the unit vector along the incident ray
  • b i is the distance of the plane to the origin of the reference frame
  • u 1 is the unit vector normal to the plane
  • d is indirect path length.
  • Equation (3) is a scalar offset distance that contains contributions from all m reflections.
  • w m+1 is the unit vector from the last specular point to the tag and contains potentially useful information regarding the geometry of the indoor space.
  • the multipath parameters vary as the tag moves through the indoor space (e.g., from Point A to Point B). If the variations are too large, the parameters may be essentially unobservable, resulting in poor performance. Generally, the variations decrease as the node moves away from the tag and are relatively small for representative indoor geometries.
  • the indirect path parameter set contains three unknown parameters in three-dimensional (3D) space and two unknown parameters in two-dimensional (2D) space.
  • Equation (3) is independent of the number of reflections, although the offset distance is significantly different.
  • the reflection subscript m is dropped in the following description.
  • a scalar path length measurement at time t may be denoted with y t and the measurement history may be denoted with The scalar measurement y t may be a direct path measurement, a measurement from an indirect path in the current library, a measurement from a new indirect path, or an erroneous measurement (not from any path).
  • the path identity is unknown.
  • the multipath parameter vector is
  • is an angle-of- arrival (azimuth), while in three dimensions
  • angle-of-arrival (elevation).
  • a measurement from the i th indirect path from the s th source at time t is expressed as [0064]
  • the objective is to simultaneously estimate tag position r t and the multipath parameter vector a for each detected indirect path.
  • the indirect path measurements for this problem are non-linear.
  • the bilinear form does allow a simplification in the estimation problem: the indirect path measurement y t conditioned on a ⁇ is linear in tag state vector x t . Conditioning over a sufficiently rich set of hypothesized multipath parameters allows the bilinear estimation problem to be solved using a set of optimal linear estimators (e.g., Kalman filters).
  • FIG. 4 shows a process flow diagram illustrating an exemplary method 600 for mapping using multipath signals in accordance with an embodiment of the present invention.
  • This exemplary mapping method 600 may involve one or more signal sources transmitting wireless signals and at least one transponding tag roving in an area of interest (e.g., inside a building).
  • Inputs to the exemplary process illustrated may include real-time locations of transmitting node(s) (signal source(s)) and receiving node(s). The location of these nodes may be established by deliberately placing them in known locations, by measuring their locations through an RF TDOA process, or by using other sensor systems such as an inertial measurement unit.
  • Direct and indirect RF signal paths can be separated using algorithms such as MUSIC or by a hardware means such as a Rake filter (Step 602), which may be implemented as a front-end pre-processing unit.
  • MUSIC is a known algorithm that detects frequencies in a received signal by performing an eigen decomposition on the covariance matrix of a data vector of multiple samples obtained from that received signal.
  • a Rake filter is a device that can isolate, from a received signal, individual signal components which are delayed versions of an original signal. Once the direct-path signals and multipath signals have been isolated, the individual signal components may be detected and an estimate the time of arrival (TOA) may be generated for each of them (Step 604).
  • TOA time of arrival
  • the accuracy of the TOA will be dependent upon the system bandwidth and the TOA processing model (e.g., single-pulse, overlapping pulses, etc.) selected. Additionally since the angle of arrival will be calculated, receiver directivity and source directivity will be factors in establishing the accuracy of the mapping process.
  • the TOA data may then undergo a data association process (Step 606) such that a multipath signal may be associated with a corresponding direct-path signal.
  • data association may be developed using polynomial projection. In one embodiment, this correlation may have already been completed with the Rake filter in Step 602. In other embodiments, the association may be based on the identification of a direct-path signal and associating it with multipath signals detected within a limited time window following the TOA of that direct-path signal.
  • an appropriate filter e.g., an extended Kalman filter, a nonlinear filter, or a particle filter
  • an extended Kalman filter may be applied to the TOA data to simultaneously estimate the receiver (tag) position and multipath parameters, which may take place here in Step 610.
  • the type of filter most suited to a particular application depends on the details of the application. If the error in the initial tag position is relatively small, then an extended Kalman filter alone may suffice. However, initially, tag location errors may be outside the linear range of an extended Kalman filter as the multipath parameters are unknown.
  • the roving receiver or tag location may be initialized using a particle filter (Step 608) to bring the location errors to within the linear range of an extended Kalman filter that recursively performs simultaneous location and multipath parameter estimation in Step 610.
  • Path persistence may be desirable in order to obtain stable multipath parameter estimates, and source directivity can be used to enhance the data association process as reduced beamwidth reduces the number of possible indirect paths.
  • the indirect path parameters are three unknown parameters in three-dimensional (3D) space and two unknown parameters in two-dimensional (2D) space, independent of the number of reflections. It does not matter that the number of reflections is unknown in practice, as the accuracy of estimating location is unaffected by the number of reflections.
  • the mapping function is performed by utilizing single bounce data only. An important issue then is to discriminate single bounce multipath from multiple bounce multipath in order to perform the mapping function. Simulation of the mapping function has shown that single bounces tend to proceed along surfaces as expected, whereas multiple bounce effects fall elsewhere, often where there are no surfaces, and tend to cluster, providing a means for discrimination.
  • a local facet model may be employed, in Step 614, to distinguish single- reflection specular points, which tend to be true facets, from those multiple-reflection specular points, which tend to be false facets.
  • the local facet model may also filter out false specular points arising from the proximity distortions.
  • the local facet model may further enhance accuracy and robustness, speed convergence in estimating multipath parameters, and provide mapping information. Facets are regarded as fixed in space, and provide an attractive set of invariants. Building constraints or a priori information, such as preferred orientations and partial maps, can be employed to enhance performance of the local facet model (Step 616). Non-real-time estimation (smoothing) techniques may be used to iteratively improve facet estimates. The use of stored data and backward smoothing techniques may further correct for the effects of past data association errors. Thus, the TOA data association can be further improved with feedback from the tracker and multipath parameter estimation (Step 610) as well as the local facet model (Step 614).
  • one or more navigation aiding mechanisms may be employed (Step 612) to assist in tracking the tag's location and in multipath parameter estimation, particularly when a direct path is unavailable.
  • Exemplary navigation aiding mechanisms include dead reckoning methods and inertial navigation systems.
  • the statistical model may consist of a state vector, a statistical propagation model, and a statistical measurement model. If the state vector is x(t) , then the statistical model may be, for example:
  • Equation (4) a possible statistical model for propagating the state vector from time t . is to time t . , is:
  • the estimated state is propagated using:
  • the filter also carries an estimate of the error covariance matrix
  • An indirect path delay measurement from a transmitting node to the tag may be modeled as:
  • n(t t ) is zero-mean white noise with variance
  • the tag may be configured to collect or re-transmit the detected data first, and the processing of the data may be delayed or postponed and performed in batch.
  • the above- described extended Kalman filter formulation allows these goals to be realized by using well- known tools of nonlinear filtering theory.
  • the bilinear form of the indirect path measurements lends itself to particularly simple recursive nonlinear filter mechanizations.
  • K d (t . ) is the extended Kalman filter gain given by:
  • the measurement residual is:
  • the state vector may be updated using an indirect path measurement in several different ways.
  • the following example assumes that the state vector estimate and the multipath parameter estimates are updated sequentially in two separate steps. In both steps, it is assumed that an extended Kalman filter is used.
  • K x (t t ) is the extended Kalman filter gain:
  • the parameter vector is defined as:
  • K (t . ) is the extended Kalman filter gain:
  • FIGs. 5A-C show a floor plan of a building to illustrate one exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention.
  • the floor plan represents an experimental setting in which the multipath mapping method was tested. In this experimental setting, most of the walls may either reflect wireless signals or allow the wireless signals to pass through with some attenuating effect, except that an object C is completely opaque to the wireless signals.
  • FIG. 5A there are shown two signal transmitters Sl and S2 that are placed in two rooms some distance apart.
  • the dashed lines and arrows indicate a trajectory for a transponding tag (not shown).
  • the tag may have the capabilities of receiving wireless signals that originate from Sl and S2, pre-processing the signals, and optionally retransmitting the processed or pre-processed data to another processor for map generation.
  • the tag may start detecting signals at Point A and finish detecting at Point B.
  • FIGs. 5B and 5C show ray trace data based on the floor plan, the tag track A-B, and the locations of transmitters Sl, S2 and of Object C. Exemplary rays of wireless signals are shown as solid lines with arrows.
  • portions of walls that can reflect or attenuate wireless signals from the transmitter Sl are marked with dotted oval circles (indicating single reflection surfaces) and dotted rectangular boxes (indicating attenuating layers) respectively.
  • portions of walls that can reflect or attenuate wireless signals from the transmitter S2 are marked with dotted oval circles (indicating single reflection surfaces) and dotted rectangular boxes (indicating attenuating layers) respectively. It can be noted that, between FIGs.
  • most of the walls along the tag track between Point A and Point B can potentially serve as single-reflection surface for at least one of the transmitters Sl and S2.
  • a portion of the walls between Point A and Point B does not reflect wireless signals from either transmitter.
  • the ray trace data illustrated and described herein may later be used to verify the multipath mapping results achieved with the tag and the signal sources (i.e., transmitters Sl and S2).
  • FIG. 6 shows a floor plan of a building to illustrate exemplary mapping results using multipath signals in accordance with an embodiment of the present invention. This floor plan is the same as the one shown in FIG. 5A with a similar setting of two transmitting sources
  • the wall surfaces are clearly mapped as they coincide with the single-reflection points.
  • the multiple- reflection signals result in artificial reflection locations elsewhere within the building, generally clustered into groupings that are identifiable (e.g., cluster 702).
  • Proximity effects e.g., false reflection points 704 can be observed in the vicinity of S2 because the tag has moved too close to the source S2.
  • FIG. 7 shows a layout of an exemplary system for satellite-based urban and indoor mapping using multipath signals in accordance with an embodiment of the present invention.
  • the satellite-based mapping is implemented with one or more receivers that are augmented with a Rake processor and implanted in fixed locations close to an area of interest.
  • the receivers may be GPS, Iridium, or other type of receivers. For ease of description, it is assumed that a GPS receiver is employed, as shown in FIG. 7, to map the indoor space of a building.
  • the GPS receiver may be positioned outside the building to be mapped and at an elevated location, or where an unobstructed sight of the building and at least one GPS satellite is available. In the setup shown in FIG. 7, the GPS receiver is located on the roof of another building. Only two GPS satellites, SAT-I and SAT-2, are shown although more satellites may be beneficial. GPS signals originating from the satellites may be received by the GPS receiver in a number of ways, such as via a direct path, via a single-reflection multipath after bouncing off an exterior surface of the building, or via a more complex multipath after penetrating the building's exterior walls and experiencing one or more reflections inside the building.
  • the GPS receiver may gather both the direct-path signals as well as all those multipath signals having time differences consistent with the area to be mapped.
  • the satellite constellation's motion provides a desirable dynamic scanning of the infrastructure.
  • the direct-path and multipath time differences are then processed to produce 3-D transparency maps of the building. Because both the direct-path and multipath signals, subsequent to structural penetration and reflection, are received by the same receiver, the timing synchronization that typically limits coherence techniques is less important. [0095] While many frequencies, such as L-band, are well suited for structural penetration, these signals are normally considered too weak for detection subsequent to multiple internal reflections and upon exiting a building structure.
  • RF signals that enter a building are subject to multiple interior reflections and, upon exiting the building, will be detected by a receiver exterior to that building.
  • these signals are normally down approximately 156 dBW to start with and may suffer an additional 40 dB or more attenuation before exiting the building. Given this level of attenuation, this might seem to be a hopeless task.
  • coherent processing techniques have demonstrated the reception of indoor GPS signals as much as 60 dB below their reference signal levels outdoors.
  • a direct- path GPS signal is received exterior to the building infrastructure, and that signal becomes the basis for timing the measurements of the interior reflected signals, both in code and Doppler, and it enables the described mapping algorithms to develop 3-D interior structural images over an extended period of observation.
  • This mapping concept is somewhat similar to tomography in the sense that GPS satellites' motion provides a scanning of the mapped structure.
  • the geometry-based multipath delay model may be used to determine points of reflection directly from the multipath data.
  • satellite-based transparency mapping requires statistical analysis of reflection points and the use of context to determine characteristics of objects or surfaces of interest (e.g., location, size, texture, motion, etc.).
  • characteristics of objects or surfaces of interest e.g., location, size, texture, motion, etc.
  • the combination of satellite position, building infrastructure multipath reflection and transmission characteristics, and receiver position can result in a relatively short time interval of RF observation for diverse sections of the infrastructure, akin to a reception of random RF pixels.
  • the satellite constellation “paints" different structural reflection combinations from different aspect angles, these RF pixels will eventually develop into a 3-D transparent image of the surrounding structure.
  • the transparency mapping system allows the development of 3-D transparent images and maps of urban areas of interest.
  • the GPS receiver which is adapted to receive multipath signals, may be used in determining the relationship between the receiver location and the multipath signals by separately identifying related multipath signals and the direct-path signal (each signal having originated from the same source). Because GPS signal strength detected in the transparency mapping may be extremely low, special techniques may be desirable to recover the signal.
  • RF communication signal strength can often be enhanced by the process of coherent integration. There are typically two different codes embedded in a GPS signal, a PRN code at a high rate (e.g., 1 or 10 MHz) and a data message at a slower rate (e.g., 50 Hz).
  • the degree of coherent integration that can be achieved in a GPS receiver is normally limited by the data message rate to no more than 20 milliseconds as message changes will preclude predictable coherent integration beyond that time interval.
  • Data wiping is a process of coherent integration of the signal that may be used to increase the signal-to-noise ratio (SNR) in GPS receivers. It consists of prior extraction of the data message from the received signal, enabling coherent integration beyond the limits imposed by the data message.
  • SNR signal-to-noise ratio
  • FIG. 8 illustrates an exemplary data wiping method for satellite-based transparency mapping in accordance with an embodiment of the present invention.
  • GPS data wiping is successfully performed by processing both a reference signal (i.e., a clean GPS signal, without multipath, directly from overhead) and those multipath signals emanating from within an urban structure 1002 using a single GPS receiver 1004.
  • a reference signal i.e., a clean GPS signal, without multipath, directly from overhead
  • multipath signals emanating from within an urban structure 1002 using a single GPS receiver 1004.
  • the GPS direct signal 1008 is received at the GPS receiver 1004 from the satellite constellation 1006, and the multipath signal 1010, containing urban structural data, is also received at the same GPS receiver 1004.
  • the satellite constellation 1006 provides a scanning motion. At any single instant in time, the combination of satellite position, building infrastructure multipath reflection and transmission characteristics, and receiver position may result in a relatively short time interval of RF observations for diverse sections of the structure 1002. Over time, as the satellite constellation 1006 "paints" different structural reflection combinations from different aspect angles, these RF pixels will develop into a 3-D transparent image of the structure 1002.
  • FIG. 9 shows a block diagram illustrating an exemplary system 1100 for satellite- based transparency mapping in accordance with an embodiment of the present invention. For a conceptual illustration, only one GPS satellite 1101 and one GPS receiver 1103 are shown.
  • the GPS satellite 1101 may modulate both a PRN code sequence (e.g., P Code) and a data message onto a L-band carrier wave.
  • the resulting signal is transmitted through an intervening medium including a free space transmission channel and/or a structure transmission channel (i.e., penetration and reflection within a structure). Therefore, the signal may arrive at the GPS receiver 1103 via two principle paths: the direct sky path and the indirect multipath via reflection from the urban infrastructure.
  • the GPS receiver 1103 may implement a first data path that includes low-pass filter (LPF) 1102, analog-to-digital (A/D) converter 1104, correlator 1106, and processor 1108.
  • LPF low-pass filter
  • A/D analog-to-digital
  • the indirect multipath signals arrive at the GPS receiver 1103 delayed from the direct path signals.
  • the indirect multipath signals may be processed along a second data path that includes low-pass filter (LPF) 1110, analog-to- digital (A/D) converter 1112, correlator 1114, and accumulator 1116.
  • LPF low-pass filter
  • the time delay or synchronization required between the direct and indirect signals is achieved by matching the PRN code sequence through an autocorrelator function. Delay between the direct-path and multipath signals may be resolved within a single chip length (a chip is the pulse width of a single pulse in a PRN code sequence), as described in more detail below.
  • the correlator 1114 may then pass the indirect multipath signal to an accumulator 1116 that performs coherent integration necessary to provide RF visibility into an urban structure. J. Multipath Signal Resolution
  • FIG. 10 shows a block diagram illustrating an exemplary signal resolution autocorrelation method for satellite-based transparency mapping in accordance with an embodiment of the present invention.
  • a transmitter 1200 In operation, a transmitter 1200 generates a PRN code sequence at a higher rate than a data message rate, resulting in a spread spectrum transmission.
  • the received signal is typically correlated in the receiver 1202 with a locally generated replica of the PRN code sequence.
  • the correlator 1204 response peaks and the message becomes observable.
  • the received signal after passing through the transmission medium 1206, can, however, become adulterated by the reflections of the transmitted signal (multipath signal) mixing with the received direct signal.
  • the mixing of the direct signal and a reflected signal is depicted in FIG. 11. This illustration is simplified to show only a single reflected signal whereas in reality there may be several multipath signals.
  • FIG. 11 This illustration is simplified to show only a single reflected signal whereas in reality there may be several multipath signals.
  • this received signal (with the new shape) is correlated with an idealized replica of the transmitted PRN pulse shape, as shown, over a single chip length.
  • the correlation process does not involve two similarly shaped pulses, the correlation function appearance does not take on the traditionally accepted triangular shape but has a new shape, with a flatter top, making the location of the direct signal difficult.
  • a receiver according to embodiments of the present invention may synthesize a PRN code reference that has the shape of the received signal.
  • the delay ⁇ between the direct-path and multipath signal is unknown, this requires scanning of different values of ⁇ until the correlation function peaks.
  • an ideal PRN replica is generated in a PRN replica generator 1208.
  • a delayed (and possibly attenuated) version of the same code sequence is generated through a delay element 1210. Then, the two code sequences are added to form a new PRN shape which is correlated to the received signal. If the correlation 1204 response does not peak, an error signal 1212 is sent to the delay element 1210 to further adjust the delay value ⁇ . Through this feedback mechanism, autocorrelation between the received signal and the synthesized PRN may continue until the delay value ⁇ is correct. This ⁇ value represents a physical distance between the direct-path signal and the multipath signal.
  • the fundamental measurements available to an indoor mapping system are the direct and indirect path lengths.
  • the path identities i.e., direct and indirect
  • the path identities are unknown and must be inferred from the measurements. It will be assumed throughout this discussion that: the identity and location of all sources is known; the locations and orientations of all reflecting surfaces are unknown; and the number of reflections associated with all indirect paths is unknown. Under these assumptions, determininistic expressions are derived for indirect path length for an arbitrary number of reflections. These expressions form the basis of the measurement equations used by the indoor mapping system.
  • FIG. A-I The geometry for one specular reflection is shown in FIG. A-I.
  • the source is at known location s and the tag is at unknown location r .
  • the direct path length is
  • w is the unit vector along the ray from the last reflecting surface and c is a constant that depends on the source location, the unit vector along the ray from the source to the first reflecting plane, all of the reflection angles, and all of the reflecting plane locations.
  • Equation (A.38) forms the basis of the measurement equations used in the indoor mapping system. It is worth noting that (A.38) is a phenomenological model of the indirect path length that explicitly contains exactly four indirect path parameters ⁇ w ' c * for any number of reflections. This implies that mapping using indirect path measurements can be accomplished if the four indirect path parameters associated with the current measurement are known or can be estimated with sufficient accuracy. Moreover, the four indirect path parameters are not independent, since w is uniquely defined by two angles. Thus, the phenomenological model of indirect path length actually contains three independent parameters.

Abstract

Systems and methods for mapping a structure detect wireless signals, including at least one multipath signal that has experienced at least one reflection against a portion of the structure prior to the detection. The wireless signals are analyzed to estimate reflection points for the multipath signal(s), and a map of at least the portion of the structure is generated based on the estimated reflection points.

Description

SYSTEMS AND METHODS FOR TRANSPARENCY MAPPING USING MULTIPATH SIGNALS
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to and the benefit of United States Provisional Patent Application No. 60/977,519 (Docket No. DPL-073P3), filed on October 4, 2007, and United States Provisional Patent Application No. 60/973,314 (Docket No. DPL-099PR), filed on September 18, 2007, both of the disclosures of which are hereby incorporated herein by reference in their entirety.
FIELD OF THE INVENTION
[0002] In various embodiments, the present invention relates to mapping techniques, and more specifically to systems and methods for transparency mapping using multipath signals, such as remote interior and exterior three-dimensional transparency mapping of urban environments and building structures.
BACKGROUND OF THE INVENTION
[0003] With conventional mapping techniques, an observer (or his equipment) typically has to have a direct line of sight to an object to be mapped. If a portion of the object is out of sight, it may not be represented in a final map generated with the conventional techniques. This is true for existing mapping techniques such as land survey (with total stations), photo- mapping, photo grammetry, and remote sensing methods.
[0004] Many remote- sensing exterior mapping techniques rely on direct reflection of radio-frequency (RF) signals, microwave signals, or other type of signals to detect the presence of objects and to map their locations. For example, an RF signal may be transmitted from a source and directed towards an area of interest, and objects in that area may reflect the RF signal back towards the source. The reflected signals can be collected at the signal source and their time of arrival (TOA) may be used as a basis for determining a relative distance between the source and the reflective objects. This is the general operating principle for radar and sonar. More complex operations might employ two or more transceivers to triangulate object locations.
[0005] These remote- sensing mapping techniques, however, suffer from a number of deficiencies. For example, to be accounted for in a final map, an object generally must be within line of sight of at least one transceiver. Even within line of sight, object surfaces that do not reflect a transceiver's signal directly back to that transceiver are effectively "invisible" to the transceiver and therefore will not be charted in the map. Typically, anything other than narrow- angled, single-reflection signals is either not detected or filtered out as noise. As a result, a substantial portion of signals that bounce off an object end up not contributing any geometric information to the final map.
[0006] In mapping techniques that are based on a coordinated deployment of signal source(s) and receiver(s), one or more receivers (e.g., transponder tags) may move across an area of interest and simultaneously detect signals from one or more sources. Based on the detected signals, the receivers' coordinates at different locations in the area may be calculated and synthesized into a map. Again, the receiver or tag must typically have a direct line of sight to the signal source(s) in order to accurately determine its own location. In a cluttered environment, such as an urban canyon or an enclosed structure, the receiver or tag may lose direct sight of signals, making it difficult to use direct-path signals for mapping. In this approach, the reflected signals are typically treated as unwanted noise.
[0007] Therefore, it has been difficult, if not impossible, to employ conventional mapping techniques in a cluttered environment, such as an urban canyon, or an enclosed structure, such as a building. Such environment or structures tend to generate multipath signals (i.e., signals experiencing one or more reflections between source and detection), making it difficult to rely on direct-path signals alone for the mapping. FIG. 1 illustrates exterior mapping for an exemplary urban environment cluttered with Buildings A, B and C. TCl and TC2 are two externally located RF transceivers, which may be fixed or mobile transceiver devices. As illustrated in FIG. 1, it may be difficult to employ TCl and TC2 to map Building C based on existing mapping techniques. Since Buildings A and B are much taller than Building C, the transceivers TCl and TC2 may have a difficult time gaining an unobstructed sight of Building C. Thus, it is difficult for either TCl or TC2 to detect any RF signal reflected by Building C. In addition, RF signals from TCl and TC2 may be reflected one or more times by Buildings A and B (or other objects) before reaching Building C. Therefore, it is also difficult for RF receivers or transponding devices placed on, near or inside Building C to detect direct-path RF signals from TCl or TC2. In these circumstances, the existing mapping approaches would be incapable of mapping the exterior or interior of Building C, because those approaches either cannot fully exploit geometric information in multipath signals or simply discard multipath signals as unwanted noise. Signals reflecting from the interior surfaces of the building structures are even more difficult to incorporate into the overall mapping process for the same reasons.
[0008] Accordingly, there is a need for improved systems and methods that can map a cluttered environment, such as an urban canyon, or an enclosed structure, such as a building, without the aforementioned problems or deficiencies.
SUMMARY OF THE INVENTION
[0009] In various embodiments, the present invention relates to systems and methods for mapping a cluttered environment, such as an urban canyon, or an enclosed structure, such as a building. The structure-penetrating capability of many RF signals can provide information about interior surface distances as well as building exterior surface distances. The exemplary systems and methods described herein recognize that substantial information is available in multipath signals even when a direct-path signal is absent or undetected.
[0010] One object of the invention is to use radio frequency (RF) signals or other wireless signals to map a cluttered exterior or interior environment, wherein multipath signals may be analyzed to identify objects or surfaces not in direct line of sight to a signal source or a receiver.
[0011] In general, in one aspect, embodiments of the invention feature a method for mapping a structure. The method may include: detecting, at a receiver, a first wireless signal transmitted directly from a satellite; deriving, from the first wireless signal, a location of the satellite; detecting, at the receiver, a second wireless signal transmitted by the satellite and reflected by a structure; determining a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal; and mapping at least one reflection point associated with the structure. The mapping may be based on the TDOA, a location of the receiver, and the location of the satellite. - A -
[0012] In general, in another aspect, embodiments of the invention feature a system for mapping a structure. The system may include a receiver at a known location and one or more signal processing elements operatively coupled to the receiver. The receiver and the signal processing elements may be configured to: (i) detect a first wireless signal transmitted directly from a satellite, (ii) derive, from the first wireless signal, a location of the satellite, (iii) detect a second wireless signal transmitted by the satellite and reflected by a structure, (iv) determine a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal, and (v) map at least one reflection point associated with the structure. The mapping may be based on the TDOA, the location of the receiver, and the location of the satellite.
[0013] In various embodiments, the receiver and the signal processing elements are further configured to derive, from the first wireless signal, a code sequence and a data message. The receiver and the signal processing elements may also be configured to perform data wiping and coherent integration on the second wireless signal before determining the TDOA. In another embodiment, the receiver and the signal processing elements are configured to: (i) detect a signal having the first wireless signal and the second wireless signal mixed together; (ii) synthesize a replica of the detected signal by varying a first delay applied to the code sequence and mixing the resulting delayed code sequence with the code sequence until the resulting mixed code sequence matches the detected signal; and (iii) correlate the replica with the detected signal by varying a second delay applied to the replica until a correlation peak occurs between the delayed replica and the detected signal.
[0014] In still another embodiment, a plurality of first wireless signals and a plurality of second wireless signals both originating from one or more satellites may be detected, and the receiver and the signal processing elements may be further configured to (i) isolate, from the pluralities of wireless signals, a subset of wireless signals that originate from a same satellite and (ii) identify, from the subset of wireless signals, a direct path signal and at least one corresponding multipath signal that has reflected off of the structure. In addition, the receiver and the signal processing elements may be further configured to determine a delay between the at least one corresponding multipath signal and the direct path signal.
[0015] In general, in yet another aspect, embodiments of the invention feature another method for mapping a structure. The method includes detecting a plurality of wireless signals that comprise at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection. The plurality of wireless signals may be received from one or more sources and be detected with at least one receiver. The method may also include analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal. In addition, the method may include generating a map of at least the portion of the structure based on the estimated reflection points.
[0016] In general, in still another aspect, embodiments of the invention feature another system for mapping a structure. The system includes at least one receiver for detecting a plurality of wireless signals originating from one or more sources. The plurality of wireless signals include at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection. The system may also include a processor, associated with the at least one receiver, for i) analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal and ii) generating a map of at least the portion of the structure based on the estimated reflection points.
[0017] The one or more sources may include, for example, one or more mobile transmitters (such as satellites moving in space), or at least two transmitters at known terrestrial locations. The at least one receiver may move along a known trajectory within or near the structure, or it may move along an unknown trajectory within or near the structure and the system may be configured to track a location of the receiver. Tracking the location of the receiver and generating the map may take place at substantially the same time and in recursive steps.
[0018] In one embodiment, the system also includes a Rake filter for processing a multipath signal in order to correlate the multipath signal with a corresponding direct path signal. The processor may be configured to (i) determine a time delay between the multipath signal and the corresponding direct path signal and (ii) estimate one or more parameters associated with a multipath delay model. In another embodiment, the receiver is configured to assign one of the plurality of wireless signals to a corresponding signal path. The processor may be further configured to distinguish the at least one multipath signal from a corresponding direct-path signal, to associate the at least one multipath signal with a corresponding direct- path signal, to iteratively estimate one or more multipath parameters associated with a multipath delay model, to distinguish single-reflection multipath signals from multiple- reflection multipath signals, to identify one or more true reflection surfaces responsible for producing the at least one multipath signal based on a statistical inference, and/or to eliminate one or more erroneous mapping points that result from a proximity effect. The one or more multipath parameters for a multipath signal may include an angle-of-arrival from a last reflection experienced by the multipath signal. According to still another embodiment, generating the map may be based on both direct-path signals and multipath signals in the plurality of wireless signals.
[0019] The foregoing and other features and advantages of the present invention will be made more apparent from the description, drawings, and claims that follow.
BRIEF DESCRIPTION OF DRAWINGS [0020] The advantages of the invention may be better understood by referring to the following drawings taken in conjunction with the accompanying description.
[0021] FIG. 1 illustrates exterior mapping for an exemplary urban environment cluttered with Buildings A, B and C.
[0022] FIGs. 2A-C illustrate the geometry associated with one or more specular reflections in accordance with embodiments of the present invention.
[0023] FIG. 3 shows a flow chart illustrating an exemplary method for mapping based on multipath signals in accordance with an embodiment of the present invention.
[0024] FIG. 4 shows a process flow diagram illustrating an exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention.
[0025] FIGs. 5A-C show a floor plan of a building to illustrate one exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention.
[0026] FIG. 6 shows a floor plan of a building to illustrate exemplary mapping simulation results using multipath signals in accordance with an embodiment of the present invention.
[0027] FIG. 7 illustrates a system for mapping using multipath signals in accordance with an embodiment of the present invention. [0028] FIG. 8 illustrates the structural geometry for enhancing satellite-based signals through data wiping for transparency mapping in accordance with an embodiment of the present invention.
[0029] FIG. 9 shows a block diagram illustrating an exemplary system for satellite-based transparency mapping in accordance with a data wiping embodiment of the present invention.
[0030] FIG. 10 shows a block diagram illustrating an exemplary multipath signal resolution method for satellite-based transparency mapping in accordance with an embodiment of the present invention.
[0031] FIG. 11 shows exemplary waveforms for signal resolution, PRN generation, and signal autocorrelation processes in accordance with an embodiment of the present invention.
[0032] FIG. A-I is another depiction of the geometry associated with a single specular reflection.
[0033] FIG. A-2 is another depiction of the geometry for two consecutive specular reflections.
[0034] In the drawings, like reference characters generally refer to corresponding parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed on illustrating the principles and concepts of the invention.
DETAILED DESCRIPTION OF THE INVENTION
A. The Exploitation of Multipath Signals [0035] In brief overview, embodiments of the present invention provide signal detection and processing techniques for indoor or transparency mapping applications. Rather than treating multipath signals as noise and attempting to mitigate multipath-induced errors, these techniques decode and exploit geometric information within multipath signals. Embodiments of the present invention rely on well-established wireless signal transmission and receiving means to perform two-dimensional (2-D) and/or three-dimensional (3-D) mapping of cluttered outdoor and/or indoor environments. In a generalized setting, one or more signal sources may be configured to transmit signals at known locations within or near an indoor or outdoor environment, while one or more receivers (e.g., detectors or transponding tags) may receive the resultant wireless signals within or near the environment. The signal sources may be transmitters at fixed or variable locations within or near a building. The receivers may be moving along a certain trajectory or be in a fixed position inside or outside the building.
[0036] Typically, at least one of the signal sources or the receiver is in (scanning) motion to provide some perspective of the mapped object. Wireless signals received by a receiver may include both direct-path and indirect path (i.e., multipath, reflected) signals. In one embodiment, the multipath time-of-arrival or time-of-flight measurements are processed with a parametric model of indirect path length (or a multipath delay model) which contains angle - of-arrival as well as distance information. The parametric model is developed by ray-tracing one or multiple reflective paths and is based on the geometry of ideal specular reflections. With the parametric model, estimated locations of the last reflection points are calculated. True RF reflection surfaces (facets) can be established by statistically distinguishing single- reflection paths from multiple reflection paths. The estimated reflection points and facets, as well as a priori information (e.g., partial map), if any, can then be synthesized to provide geometric details of a cluttered environment. The direct-path time-of-flight measurement is useful for establishing a current position of the receiver and to initialize multipath parameters.
[0037] Embodiments of the invention have potentially important commercial and military applications. These include, for example: (1) providing real-time indoor infrastructure information to first responders (e.g., policemen, firemen, and antiterrorist personnel) when maps may not exist or may have changed due to fire/explosions, etc.; and (2) efficient and inexpensive real-time mapping of warehouses, hospitals, etc. (including updating of current maps to address recent movement of significant objects such as large equipment, storage cabinets, etc.). In both scenarios, the indoor infrastructure or layout may have recently changed, rendering current maps obsolete; in this case, the real-time capability of the exemplary embodiments described herein allows timely updating of the maps.
[0038] In connection with these developments, it has been determined that the indirect- path distance for specular reflections from planar surfaces can be modeled using only two parameters in two dimensions and three parameters in three dimensions, no matter the number of specular reflections. Using this model, as discussed in more detail below, relevant parameters may be estimated in real time or in batch, thereby providing a basis for establishing reflection points. B. Multipath Mapping Concept
[0039] In one embodiment of the multipath mapping concept, one or more Rake filters (or similar or equivalent means) are used to isolate a direct-path signal and its corresponding multipath signals. In another embodiment, time delay measurements of the direct and indirect multipath signals are processed using one or more of data association, initialization, parameter estimation, and tracking filters. A data association algorithm may be used to enhance tracking of intermittent direct and indirect path measurements. In yet another embodiment, a particle filter is used to reduce the initial receiver position uncertainty to a region where an extended Kalman filter can be used for both indirect path parameter estimation and tracking. In further embodiments, dead-reckoning sensors or other navigation aids are used to slow error growth in measurements or to aid in the data association process.
[0040] FIGs. 2A-C illustrate the geometry associated with one or more specular reflections in accordance with embodiments of the present invention. As shown in FIG. 2A, a wireless signal may be transmitted initially from a source s and experience multiple specular reflections before being detected by a receiver r.
[0041] With reference to FIG. 2B, which shows a single specular reflection, the derivation of a multipath delay model may begin by assuming ideal specular reflection from a single planar surface. The following equation describes the relation between indirect path length T = d0 + d1 and receiver location vector r :
Figure imgf000010_0001
where W1 is a unit vector; s is the location of the signal source; u1 is the unit vector defining
the reflecting plane orientation; C1 is the scalar satisfying , such that rp is any point
Figure imgf000010_0004
in the reflecting plane; and
Figure imgf000010_0002
which represents the transformation (or reflection) matrix associated with the reflection plane (and where / is the identity matrix).
[0042] Assuming that the reflecting plane and the source S are fixed, the indirect path length at time t satisfies:
Figure imgf000010_0003
wherein ρ 0 is constant. Thus:
Figure imgf000011_0001
[0043] If the signal source is not too close to the reflecting plane, then the four multipath parameters w At) (i.e., a vector including three parameters) and ^ (t) (i.e., a single sealer parameter) are essentially constant if r(t) is assumed to be confined to a suitably small region. This allows the estimation of w and τ within the region using standard filtering or estimation techniques if substantially simultaneous measurements of τ(t) and r(t) are available and the receiver is in motion.
[0044] These multipath parameter estimates can subsequently be used to track r(t) using indirect path measurements when other measurements of r(t) are unavailable (for example, when the direct path is lost). Since r(t) , w (t) and τ (t) are random variables and measurement of τ(t) is subject to error, a nonlinear filter may be used to accurately track tag location r(t) .
[0045] Alternatively, assuming that the reflecting plane and the receiver r are fixed, the indirect path length at time t satisfies:
Figure imgf000011_0002
wherein P1 is constant. Thus:
Figure imgf000011_0003
[0046] While this analysis is presented for a single multipath bounce, the results are applicable independent of the number of multipath reflections that take place, although the four multipath parameters have a different analytical form. For example, FIG. 2C presents the generalized three-dimensional multipath geometry for two specular reflections. The geometry is similar to that illustrated in FIG. 2B, with the inclusion of a second reflecting surface defined by a unit vector u2 and a scalar value c2 . The following equation describes the relationship between indirect path length T = d + d + d and tag location vector r :
Figure imgf000012_0001
wherein
Figure imgf000012_0002
and E2 represents the transformation (or reflection) matrix associated with the second reflection plane c2 .
[0047] Assuming that both reflecting planes and the signal source are fixed, the indirect path length at time t can be described as:
Figure imgf000012_0003
wherein ρ02 is constant. Thus:
Figure imgf000012_0004
which is of the same form as the one reflection case (i.e., Equation (I)).
[0048] Equations (1), (I)* and (2) are in the form of a measurement equation that can be used by an appropriate filter (e.g., an extended Kalman filter, a nonlinear filter, a particle filter) to simultaneously estimate the receiver position r and the four multipath parameters
Figure imgf000012_0005
[0049] As discussed in Appendix A, the single-reflection and double-reflection cases may be generalized to formulate an expression for indirect path length as a function of receiver location and four parameters for any number of specular reflections. For n reflections, the
four parameters are , where w
Figure imgf000012_0006
n is the unit vector in the direction of the path from
the last reflecting surface and τOn is the scalar g oeometry-dependent offset. Since w n can be expressed as a function of two angles, there are only three independent parameters to be estimated.
[0050] The mathematical framework as detailed above and in Appendix A is useful for both navigation (or tracking of receiver) and mapping applications. When the locations of the source and the receiver are known or otherwise determinable, the last reflection point (or facet) for each multipath signal may be calculated. Those reflection points (or facets) may then be synthesized to map a structure and/or objects responsible for generating the multipath signals. Secondary (deeper) facets may be determined by bootstrapping from last- reflection facets based on two-reflection and ^-reflection models described below.
[0051] It has been empirically determined from simulation that the most robust model (i.e., four-parameter or three-parameter) is application-dependent.
C. Multipath Delay Processing
[0052] FIG. 3 is a flow chart of an exemplary processing method 300 for mapping based on a multipath delay model in accordance with an embodiment of the present invention.
[0053] In step 302, one or more receivers may be positioned at known or determinable location(s) in relation to a structure or object of interest. The structure or object to be mapped may be a building or a group of buildings (e.g., a building complex). According to one embodiment of the present invention for mapping the interior of a building, a single receiver such as a transponding tag may be placed inside the building sequentially at a number of known locations. Or, the single receiver may be moving along a known trajectory within the building. Alternatively, two or more receivers may be placed at fixed known locations inside and/or outside the building.
[0054] In step 304, wireless signals that originated from one or more sources may be detected. The one or more sources may also have known or determinable locations. The one or more sources may be either fixed or moving. According to one embodiment, the sources may include RF transceivers carried by manned or unmanned aerial vehicles or satellites. Alternatively, the sources may be wireless signal transmitters at fixed locations near the building to be mapped. Preferably, each signal source transmits wireless signals that can be reliably associated with that source or distinguished from other sources. Therefore, it may be desirable to encode wireless signals from different sources with distinguishable data, patterns and/or waveform shapes.
[0055] The wireless signals detected in step 304 may include both direct-path and multipath signals that are mixed together. In step 306, the detected signals may be processed and/or filtered to distinguish and associate the direct-path and multipath signals. That is, for it to be useful, each multipath component of the detected signal should be isolated or identified and then matched up with its corresponding direct-path signal. Part of the goal is to determine indirect path lengths (or multipath delays) from which geometric information of the building can be derived.
[0056] In step 308, specular points responsible for producing the multipath signals may be calculated based on a multipath delay model. The multipath delay model may be developed on the assumption that multipath signals result from ideal specular reflections only, as shown herein and in Appendix A. The location of a specular point (e.g., last reflection) is just one set of variables in the multipath delay model to be solved. When the other variables, such as source location and receiver location, are known or estimated, the specular point may be solved for each individual instance of multipath signals.
[0057] In step 310, the specular points calculated in step 308 may be synthesized and filtered to generate a map of the structure of interest. According to some embodiments, the specular points calculated or estimated with the multipath delay model may contain false positives (i.e., extraneous map points) due to imperfection or inaccuracies in signal processing and/or mathematical assumptions. A statistical inference method may be used to distinguish true facets (typically associated with single-reflection paths) from false reflection points (typically associated with multiple-reflection paths). It has been discovered that estimated points associated with a single reflection tend to cluster along the true RF reflection surfaces (facets), while estimated points associated with multiple reflections tend to map into large, poorly defined, clusters. This phenomenon allows the single-reflection paths and true reflection points to be discriminated from the multiple-reflection paths and false reflection points.
[0058] In some of the above-described steps, certain known information about the structure may be used to enhance the signal processing and map generation. For example, a partial map of the building of interest may be available and can be useful for enhancing or correcting the mapping results. It may also be hypothesized that most of the building walls are substantially vertical and the floors/ceilings are essentially horizontal. If it is known that a portion of the building has changed recently (e.g., due to fire or explosion), less of a weight may be placed on a prior map or floor plan of that portion.
D. Multipath Mapping Algorithm Development
[0059] For a transponding tag roving in a cluttered environment, the signal received at a node after reception and retransmission from the tag may be modeled as:
Figure imgf000015_0001
wherein z(t) is the transmitted signal, subscript / refers to the ith path (i = 0 is the direct path, and i > 0 is an indirect path), at(t) is the complex attenuation factor, τt(t) is the path delay, n(t) is noise, m is the number of indirect paths, and τd is the processing delay within the tag, which is assumed to be known. The direct path delay is τo(t) = Il r{i) -s W lc , where r(t) is the tag location, s is the node location and c is the signal propagation speed. In the following, the tag state vector at time t will be denoted by xt . At a minimum, xt contains the tag position rt .
Tag position will be expressed in the following as rt=Hrxt . The tag dynamics may be modeled using a linear discrete-time equation:
Figure imgf000015_0002
wherein Φt t_1 is the state transition matrix, B is the control influence matrix, bt is a known control, Tt t_1 is the noise influence matrix, and qt is zero-mean discrete white Gaussian process noise with covariance matrix Qt , and is independent of xt and wt . In the following, it is assumed that Φt t_1 , Bt t_1 , and Γt t_1 are known, and the initial state x0 is Gaussian with mean x0 and covariance matrix F0 , thus a Gauss-Markov process.
[0060] Time delays τ, (t) have been converted into distances using a known signal propagation velocity and a single indirect path is considered. The indirect path distance after a sequence of m specular reflections off planar surfaces is derived as follows. Referring to FIG. 2A (the m-reflection geometry), the relevant equations are, for i = 1,2,..., m
Figure imgf000016_0001
wherein p is the specular point on the ith plane, d1 is the distance from the source to p1 , {di ;i = 2,3 ,m} is the distance from pi-1 to p1 , dm+1 is the distance from pm to r , W1 is the unit vector along the incident ray, bi is the distance of the plane to the origin of the reference frame, u1 is the unit vector normal to the plane, and d is indirect path length. These may be solved for the indirect path length:
Figure imgf000016_0002
which can be written in the form
Figure imgf000016_0003
wherein is a scalar offset distance that contains contributions from all
Figure imgf000016_0004
m reflections. In Equation (3), wm+1 is the unit vector from the last specular point to the tag and contains potentially useful information regarding the geometry of the indoor space.
[0061] The multipath parameters vary as the tag moves through the indoor
Figure imgf000016_0005
space (e.g., from Point A to Point B). If the variations are too large, the parameters may be essentially unobservable, resulting in poor performance. Generally, the variations decrease as the node moves away from the tag and are relatively small for representative indoor geometries.
[0062] The indirect path parameter set
Figure imgf000017_0005
contains three unknown parameters in three-dimensional (3D) space and two unknown parameters in two-dimensional (2D) space. Importantly, the form of Equation (3) is independent of the number of reflections, although the offset distance is significantly different. Hence, it does not matter that the number of reflections is unknown in practice, and the accuracy of estimating \wm+l,cm} is not affected by the number of reflections. For this reason, the reflection subscript m is dropped in the following description.
[0063] A scalar path length measurement at time t may be denoted with yt and the measurement history may be denoted with The scalar
Figure imgf000017_0004
measurement yt may be a direct path measurement, a measurement from an indirect path in the current library, a measurement from a new indirect path, or an erroneous measurement (not from any path). The path identity is unknown. A direct path measurement from a source at location r(s) to a tag at location rt may be modeled by yt =\\ rt - r(s) \\ +nt , where nt is measurement noise, which will be modeled throughout as zero-mean Gaussian white noise with rms value σn . In two horizontal dimensions the multipath parameter vector is
Figure imgf000017_0002
wherein ψ is an angle-of- arrival (azimuth), while in three dimensions
θ θ
Figure imgf000017_0001
wherein θ = angle-of-arrival (elevation). In the following, a measurement from the ith indirect path from the s th source at time t is expressed as
Figure imgf000017_0003
[0064] Thus, the objective is to simultaneously estimate tag position rt and the multipath parameter vector a for each detected indirect path. The indirect path measurements for this problem are non-linear. However, the bilinear form does allow a simplification in the estimation problem: the indirect path measurement yt conditioned on a^ is linear in tag state vector xt . Conditioning over a sufficiently rich set of hypothesized multipath parameters allows the bilinear estimation problem to be solved using a set of optimal linear estimators (e.g., Kalman filters).
E. Process Flow Illustration
[0065] FIG. 4 shows a process flow diagram illustrating an exemplary method 600 for mapping using multipath signals in accordance with an embodiment of the present invention.
This exemplary mapping method 600 may involve one or more signal sources transmitting wireless signals and at least one transponding tag roving in an area of interest (e.g., inside a building). Inputs to the exemplary process illustrated may include real-time locations of transmitting node(s) (signal source(s)) and receiving node(s). The location of these nodes may be established by deliberately placing them in known locations, by measuring their locations through an RF TDOA process, or by using other sensor systems such as an inertial measurement unit.
[0066] Direct and indirect RF signal paths can be separated using algorithms such as MUSIC or by a hardware means such as a Rake filter (Step 602), which may be implemented as a front-end pre-processing unit. MUSIC is a known algorithm that detects frequencies in a received signal by performing an eigen decomposition on the covariance matrix of a data vector of multiple samples obtained from that received signal. A Rake filter is a device that can isolate, from a received signal, individual signal components which are delayed versions of an original signal. Once the direct-path signals and multipath signals have been isolated, the individual signal components may be detected and an estimate the time of arrival (TOA) may be generated for each of them (Step 604). The accuracy of the TOA will be dependent upon the system bandwidth and the TOA processing model (e.g., single-pulse, overlapping pulses, etc.) selected. Additionally since the angle of arrival will be calculated, receiver directivity and source directivity will be factors in establishing the accuracy of the mapping process. [0067] The TOA data may then undergo a data association process (Step 606) such that a multipath signal may be associated with a corresponding direct-path signal. According to some embodiments, data association may be developed using polynomial projection. In one embodiment, this correlation may have already been completed with the Rake filter in Step 602. In other embodiments, the association may be based on the identification of a direct-path signal and associating it with multipath signals detected within a limited time window following the TOA of that direct-path signal.
[0068] As mentioned above in connection with Equations (1), (I)* and (2), an appropriate filter (e.g., an extended Kalman filter, a nonlinear filter, or a particle filter) may be applied to the TOA data to simultaneously estimate the receiver (tag) position and multipath parameters, which may take place here in Step 610. The type of filter most suited to a particular application depends on the details of the application. If the error in the initial tag position is relatively small, then an extended Kalman filter alone may suffice. However, initially, tag location errors may be outside the linear range of an extended Kalman filter as the multipath parameters are unknown. Accordingly, the roving receiver or tag location may be initialized using a particle filter (Step 608) to bring the location errors to within the linear range of an extended Kalman filter that recursively performs simultaneous location and multipath parameter estimation in Step 610. Path persistence may be desirable in order to obtain stable multipath parameter estimates, and source directivity can be used to enhance the data association process as reduced beamwidth reduces the number of possible indirect paths.
[0069] The indirect path parameters are three unknown parameters in three-dimensional (3D) space and two unknown parameters in two-dimensional (2D) space, independent of the number of reflections. It does not matter that the number of reflections is unknown in practice, as the accuracy of estimating location is unaffected by the number of reflections. In one embodiment, the mapping function is performed by utilizing single bounce data only. An important issue then is to discriminate single bounce multipath from multiple bounce multipath in order to perform the mapping function. Simulation of the mapping function has shown that single bounces tend to proceed along surfaces as expected, whereas multiple bounce effects fall elsewhere, often where there are no surfaces, and tend to cluster, providing a means for discrimination. In addition, reflections that take place when the distance between the transmitter and receiver is small exceed the linearity assumptions in the multipath algorithm and can result in proximity distortions that are rejected. Based on these observations, a local facet model may be employed, in Step 614, to distinguish single- reflection specular points, which tend to be true facets, from those multiple-reflection specular points, which tend to be false facets. The local facet model may also filter out false specular points arising from the proximity distortions.
[0070] The local facet model may further enhance accuracy and robustness, speed convergence in estimating multipath parameters, and provide mapping information. Facets are regarded as fixed in space, and provide an attractive set of invariants. Building constraints or a priori information, such as preferred orientations and partial maps, can be employed to enhance performance of the local facet model (Step 616). Non-real-time estimation (smoothing) techniques may be used to iteratively improve facet estimates. The use of stored data and backward smoothing techniques may further correct for the effects of past data association errors. Thus, the TOA data association can be further improved with feedback from the tracker and multipath parameter estimation (Step 610) as well as the local facet model (Step 614). In an embodiment where the trajectory of the tag is not known or predetermined, one or more navigation aiding mechanisms may be employed (Step 612) to assist in tracking the tag's location and in multipath parameter estimation, particularly when a direct path is unavailable. Exemplary navigation aiding mechanisms include dead reckoning methods and inertial navigation systems.
F. Multipath Parameter Estimation
[0071] An exemplary use of an extended Kalman filter is described below in connection with a statistical model. The statistical model may consist of a state vector, a statistical propagation model, and a statistical measurement model. If the state vector is x(t) , then the statistical model may be, for example:
Figure imgf000020_0001
where v(t) is tag velocity. [0072] Assuming the state vector definition of Equation (4), a possible statistical model for propagating the state vector from time t . is to time t . , is:
Figure imgf000021_0001
where is the state transition matrix, u(ti) is a known control input, / is the
Figure imgf000021_0002
identity matrix, and q(ti ) is a zero-mean white driving noise used to model uncertainties in the knowledge of the true propagation model. This model is generally applicable for small time steps ti+1 - tt and relatively constant tag velocities.
[0073] Within the filter, the estimated state is propagated using:
Figure imgf000021_0006
[0074] The filter also carries an estimate of the error covariance matrix
and superscript T denotes matrix
Figure imgf000021_0007
transpose. The error covariance matrix is propagated in the filter using:
Figure imgf000021_0004
where and where E{•} denotes mathematical expectation of the
Figure imgf000021_0005
quantity within the brackets.
[0075] Under the assumed model, two distinct measurements are available: direct path delay measurements and indirect path delay measurements. A direct path delay measurement
from a transmitting node to the tag at time t . is modeled as:
Figure imgf000021_0003
wherein s is the known location of the transmitting node, Il z Il denotes the length of the vector z , and the measurement noise n , (t. ) is modeled as a zero-mean white noise with
variance
Figure imgf000022_0001
An indirect path delay measurement from a transmitting node to the tag may be modeled as:
Figure imgf000022_0002
wherein n(tt) is zero-mean white noise with variance As noted previously, this
Figure imgf000022_0003
model for an indirect path measurement is applicable for any number of specular reflections.
[0076] Successful navigation in multipath environments might require accurate estimates of the multipath parameters and the state vector simultaneously in real time. For mapping purposes, the tag may be configured to collect or re-transmit the detected data first, and the processing of the data may be delayed or postponed and performed in batch. The above- described extended Kalman filter formulation allows these goals to be realized by using well- known tools of nonlinear filtering theory. In particular, the bilinear form of the indirect path measurements lends itself to particularly simple recursive nonlinear filter mechanizations.
[0077] Consider the process of updating the state vector estimate and error covariance matrix estimate using a direct path measurement. This is a straightforward application of standard nonlinear filtering methods, including extended Kalman filtering and particle filtering. For simplicity, the following discussion assumes the use of an extended Kalman filter.
[0078] The direct path measurement is given by Equation (7). Accordingly, the filter's estimate of this measurement is:
Figure imgf000022_0004
where a prime ( )' is used throughout to denote association with the value of a variable just prior to measurement updating. A standard extended Kalman filter is then used to update the state vector estimate and the error covariance matrix estimate using the following equations:
Figure imgf000023_0001
wherein is the measurement residual, and the measurement
Figure imgf000023_0009
' matrix
Figure imgf000023_0010
is:
Figure imgf000023_0005
and K d (t . ) is the extended Kalman filter gain given by:
Figure imgf000023_0006
[0079] Consider next updating the state vector estimate and error covariance matrix estimate using an indirect path measurement. The indirect path measurement is given by Equation (8). From this, the filter's estimate of the measurement is:
Figure imgf000023_0002
[0080] Using Equations (8) and (14), the measurement may be written as:
Figure imgf000023_0003
wherein is the error in the a priori estimate of tag position r (t) ,
Figure imgf000023_0007
is the error in the a priori estimate of the unit vector w(t) , and
Figure imgf000023_0004
Figure imgf000023_0008
is the error m the a priori estimate of the offset parameter
τ0 (t i ) . [0081] Assuming that the errors are sufficiently small that the second-order error term in Equation (15) may be neglected, the result is then:
Figure imgf000024_0002
for the indirect path delay measurement. Therefore, the measurement residual is:
Figure imgf000024_0003
[0082] The state vector may be updated using an indirect path measurement in several different ways. The following example assumes that the state vector estimate and the multipath parameter estimates are updated sequentially in two separate steps. In both steps, it is assumed that an extended Kalman filter is used.
[0083] The calculations are shown for processing a single multipath delay measurement from a single transmitting node; multiple indirect path delay measurements from multiple nodes at the same time may be processed sequentially using the identical extended Kalman filter equation forms.
[0084] For updating the state vector estimate using an indirect path measurement, the measurement residual υ (t . ) is written in the form:
Figure imgf000024_0004
where , and the measurement noise:
Figure imgf000024_0005
Figure imgf000024_0001
is modeled in the filter as zero-mean white noise with variance:
Figure imgf000024_0006
where is the error covariance matrix for the estimate
Figure imgf000025_0006
Figure imgf000025_0011
and is the error variance for the estimate With this assumption, the
Figure imgf000025_0007
Figure imgf000025_0008
variance of the measurement residual is:
Figure imgf000025_0009
[0085] The updated estimates of the state vector and the error covariance matrix are calculated using the standard extended Kalman filter equations:
Figure imgf000025_0001
wherein Kx(tt) is the extended Kalman filter gain:
Figure imgf000025_0002
[0086] For updating the multipath parameter estimates, the parameter vector is defined as:
Figure imgf000025_0003
[0087] The measurement residual given in Equation (17) is now written as:
Figure imgf000025_0004
wherein , and the measurement noise:
Figure imgf000025_0010
is modeled in the filter as zero-mean white noise with variance:
Figure imgf000026_0003
wherein is the error covariance matrix for the tag position
Figure imgf000026_0004
estimate
Figure imgf000026_0005
[0088] Under these assumptions, the variance of the measurement residual is:
Figure imgf000026_0006
wherein is the covariance matrix of the a priori parameter
Figure imgf000026_0007
vector estimation . The updated estimates of the multipath
Figure imgf000026_0008
parameter vector and the error covariance matrix are calculated using the standard extended Kalman filter equations:
Figure imgf000026_0001
wherein K (t . ) is the extended Kalman filter gain:
Figure imgf000026_0002
G. Illustrative Indoor Mapping Performance
[0089] These analytic derivations were employed to demonstrate the multipath mapping process employing the model of a real building structure to include the RF transmittive and attenuative characteristics of its structural materials. FIGs. 5A-C show a floor plan of a building to illustrate one exemplary method for mapping using multipath signals in accordance with an embodiment of the present invention. The floor plan represents an experimental setting in which the multipath mapping method was tested. In this experimental setting, most of the walls may either reflect wireless signals or allow the wireless signals to pass through with some attenuating effect, except that an object C is completely opaque to the wireless signals.
[0090] Referring to FIG. 5A, there are shown two signal transmitters Sl and S2 that are placed in two rooms some distance apart. The dashed lines and arrows indicate a trajectory for a transponding tag (not shown). The tag may have the capabilities of receiving wireless signals that originate from Sl and S2, pre-processing the signals, and optionally retransmitting the processed or pre-processed data to another processor for map generation. According to one embodiment, the tag may start detecting signals at Point A and finish detecting at Point B.
[0091] FIGs. 5B and 5C show ray trace data based on the floor plan, the tag track A-B, and the locations of transmitters Sl, S2 and of Object C. Exemplary rays of wireless signals are shown as solid lines with arrows. In FIG. 5B, portions of walls that can reflect or attenuate wireless signals from the transmitter Sl are marked with dotted oval circles (indicating single reflection surfaces) and dotted rectangular boxes (indicating attenuating layers) respectively. Similarly, in FIG. 5C, portions of walls that can reflect or attenuate wireless signals from the transmitter S2 are marked with dotted oval circles (indicating single reflection surfaces) and dotted rectangular boxes (indicating attenuating layers) respectively. It can be noted that, between FIGs. 5B and 5C, most of the walls along the tag track between Point A and Point B can potentially serve as single-reflection surface for at least one of the transmitters Sl and S2. However, due to the obstruction of the opaque Object C, a portion of the walls between Point A and Point B does not reflect wireless signals from either transmitter. The ray trace data illustrated and described herein may later be used to verify the multipath mapping results achieved with the tag and the signal sources (i.e., transmitters Sl and S2).
[0092] FIG. 6 shows a floor plan of a building to illustrate exemplary mapping results using multipath signals in accordance with an embodiment of the present invention. This floor plan is the same as the one shown in FIG. 5A with a similar setting of two transmitting sources
(Sl and S2) and a single roving receiver (not shown). The mapping results were obtained based on the methodology illustrated in FIG. 4. For single reflections, the "X" symbols indicate vertical reflection points, and the "o" symbols indicate horizontal reflection points. For clarity, only vertical multiple reflection points are shown (as indicated with "D" symbols).
With reference to FIGs. 5B and 5C, it may be seen that the wall surfaces are clearly mapped as they coincide with the single-reflection points. Referring again to FIG. 6, the multiple- reflection signals result in artificial reflection locations elsewhere within the building, generally clustered into groupings that are identifiable (e.g., cluster 702). Proximity effects (e.g., false reflection points 704) can be observed in the vicinity of S2 because the tag has moved too close to the source S2.
H. Satellite Based Transparency Mapping Example
[0093] FIG. 7 shows a layout of an exemplary system for satellite-based urban and indoor mapping using multipath signals in accordance with an embodiment of the present invention. In one embodiment, the satellite-based mapping is implemented with one or more receivers that are augmented with a Rake processor and implanted in fixed locations close to an area of interest. The receivers may be GPS, Iridium, or other type of receivers. For ease of description, it is assumed that a GPS receiver is employed, as shown in FIG. 7, to map the indoor space of a building.
[0094] The GPS receiver may be positioned outside the building to be mapped and at an elevated location, or where an unobstructed sight of the building and at least one GPS satellite is available. In the setup shown in FIG. 7, the GPS receiver is located on the roof of another building. Only two GPS satellites, SAT-I and SAT-2, are shown although more satellites may be beneficial. GPS signals originating from the satellites may be received by the GPS receiver in a number of ways, such as via a direct path, via a single-reflection multipath after bouncing off an exterior surface of the building, or via a more complex multipath after penetrating the building's exterior walls and experiencing one or more reflections inside the building. The GPS receiver may gather both the direct-path signals as well as all those multipath signals having time differences consistent with the area to be mapped. The satellite constellation's motion provides a desirable dynamic scanning of the infrastructure. The direct-path and multipath time differences are then processed to produce 3-D transparency maps of the building. Because both the direct-path and multipath signals, subsequent to structural penetration and reflection, are received by the same receiver, the timing synchronization that typically limits coherence techniques is less important. [0095] While many frequencies, such as L-band, are well suited for structural penetration, these signals are normally considered too weak for detection subsequent to multiple internal reflections and upon exiting a building structure. However, in this case, there are very short time differences between the reception of the direct-path and the multipath signals, which enables the use of special RF coherence techniques (e.g., data wiping, as described below) to enhance such signals to the required levels of detection.
[0096] RF signals that enter a building are subject to multiple interior reflections and, upon exiting the building, will be detected by a receiver exterior to that building. For GPS, these signals are normally down approximately 156 dBW to start with and may suffer an additional 40 dB or more attenuation before exiting the building. Given this level of attenuation, this might seem to be a hopeless task. However, coherent processing techniques have demonstrated the reception of indoor GPS signals as much as 60 dB below their reference signal levels outdoors.
[0097] In one embodiment, with the above-described multipath mapping concept, a direct- path GPS signal is received exterior to the building infrastructure, and that signal becomes the basis for timing the measurements of the interior reflected signals, both in code and Doppler, and it enables the described mapping algorithms to develop 3-D interior structural images over an extended period of observation. This mapping concept is somewhat similar to tomography in the sense that GPS satellites' motion provides a scanning of the mapped structure. The geometry-based multipath delay model may be used to determine points of reflection directly from the multipath data.
[0098] In one embodiment, satellite-based transparency mapping requires statistical analysis of reflection points and the use of context to determine characteristics of objects or surfaces of interest (e.g., location, size, texture, motion, etc.). At any single instant in time, the combination of satellite position, building infrastructure multipath reflection and transmission characteristics, and receiver position can result in a relatively short time interval of RF observation for diverse sections of the infrastructure, akin to a reception of random RF pixels. However, over time, as the satellite constellation "paints" different structural reflection combinations from different aspect angles, these RF pixels will eventually develop into a 3-D transparent image of the surrounding structure. I. GPS Multipath Signal Extraction & Processing
[0099] The transparency mapping system, as illustrated in FIG. 7, allows the development of 3-D transparent images and maps of urban areas of interest. The GPS receiver, which is adapted to receive multipath signals, may be used in determining the relationship between the receiver location and the multipath signals by separately identifying related multipath signals and the direct-path signal (each signal having originated from the same source). Because GPS signal strength detected in the transparency mapping may be extremely low, special techniques may be desirable to recover the signal. RF communication signal strength can often be enhanced by the process of coherent integration. There are typically two different codes embedded in a GPS signal, a PRN code at a high rate (e.g., 1 or 10 MHz) and a data message at a slower rate (e.g., 50 Hz). The degree of coherent integration that can be achieved in a GPS receiver is normally limited by the data message rate to no more than 20 milliseconds as message changes will preclude predictable coherent integration beyond that time interval. Data wiping is a process of coherent integration of the signal that may be used to increase the signal-to-noise ratio (SNR) in GPS receivers. It consists of prior extraction of the data message from the received signal, enabling coherent integration beyond the limits imposed by the data message.
[0100] FIG. 8 illustrates an exemplary data wiping method for satellite-based transparency mapping in accordance with an embodiment of the present invention. According to this embodiment, GPS data wiping is successfully performed by processing both a reference signal (i.e., a clean GPS signal, without multipath, directly from overhead) and those multipath signals emanating from within an urban structure 1002 using a single GPS receiver 1004. By processing both signals within the same unit 1004, the issue of timing instabilities is resolved and GPS signals that are more than -200 dBW down may be recovered. As depicted in FIG. 8, the GPS direct signal 1008 is received at the GPS receiver 1004 from the satellite constellation 1006, and the multipath signal 1010, containing urban structural data, is also received at the same GPS receiver 1004. Two antennas could be employed on the GPS receiver 1004, one looking up and one looking down (at the structure 1002). The satellite constellation 1006 provides a scanning motion. At any single instant in time, the combination of satellite position, building infrastructure multipath reflection and transmission characteristics, and receiver position may result in a relatively short time interval of RF observations for diverse sections of the structure 1002. Over time, as the satellite constellation 1006 "paints" different structural reflection combinations from different aspect angles, these RF pixels will develop into a 3-D transparent image of the structure 1002.
[0101] FIG. 9 shows a block diagram illustrating an exemplary system 1100 for satellite- based transparency mapping in accordance with an embodiment of the present invention. For a conceptual illustration, only one GPS satellite 1101 and one GPS receiver 1103 are shown.
The GPS satellite 1101 may modulate both a PRN code sequence (e.g., P Code) and a data message onto a L-band carrier wave. The resulting signal is transmitted through an intervening medium including a free space transmission channel and/or a structure transmission channel (i.e., penetration and reflection within a structure). Therefore, the signal may arrive at the GPS receiver 1103 via two principle paths: the direct sky path and the indirect multipath via reflection from the urban infrastructure.
[0102] The GPS receiver 1103 may implement a first data path that includes low-pass filter (LPF) 1102, analog-to-digital (A/D) converter 1104, correlator 1106, and processor 1108. Along the first data path, the direct path signals may be processed in a conventional manner that includes decoding of the data message. The indirect multipath signals arrive at the GPS receiver 1103 delayed from the direct path signals. The indirect multipath signals may be processed along a second data path that includes low-pass filter (LPF) 1110, analog-to- digital (A/D) converter 1112, correlator 1114, and accumulator 1116. Prior to a correlation process with a delayed PRN code reference (e.g., P Code), the indirect multipath signals may have their data message removed. The time delay or synchronization required between the direct and indirect signals is achieved by matching the PRN code sequence through an autocorrelator function. Delay between the direct-path and multipath signals may be resolved within a single chip length (a chip is the pulse width of a single pulse in a PRN code sequence), as described in more detail below. The correlator 1114 may then pass the indirect multipath signal to an accumulator 1116 that performs coherent integration necessary to provide RF visibility into an urban structure. J. Multipath Signal Resolution
[0103] FIG. 10 shows a block diagram illustrating an exemplary signal resolution autocorrelation method for satellite-based transparency mapping in accordance with an embodiment of the present invention.
[0104] In operation, a transmitter 1200 generates a PRN code sequence at a higher rate than a data message rate, resulting in a spread spectrum transmission. The received signal is typically correlated in the receiver 1202 with a locally generated replica of the PRN code sequence. When the received PRN code and a local PRN code match, the correlator 1204 response peaks and the message becomes observable. The received signal, after passing through the transmission medium 1206, can, however, become adulterated by the reflections of the transmitted signal (multipath signal) mixing with the received direct signal. The mixing of the direct signal and a reflected signal is depicted in FIG. 11. This illustration is simplified to show only a single reflected signal whereas in reality there may be several multipath signals. FIG. 11 shows the direct signal and a close-by multipath signal that is delayed by an unknown τ seconds. It is assumed that the multipath signal is close to the direct signal as this is the primary issue for CDMA systems, as multipath signals that are beyond one chip length do not correlate with the PRN reference signal and are rejected. The total signal received, which is the sum of the direct-path signal and the multipath signal, no longer has the pulse shape of the transmitted CDMA PRN but has a new shape as shown at the bottom of FIG. 11.
[0105] In conventional CDMA systems, this received signal (with the new shape) is correlated with an idealized replica of the transmitted PRN pulse shape, as shown, over a single chip length. As the correlation process does not involve two similarly shaped pulses, the correlation function appearance does not take on the traditionally accepted triangular shape but has a new shape, with a flatter top, making the location of the direct signal difficult. To solve this problem, a receiver according to embodiments of the present invention may synthesize a PRN code reference that has the shape of the received signal. As the delay τ between the direct-path and multipath signal is unknown, this requires scanning of different values of τ until the correlation function peaks. Thus, referring to FIG. 10, an ideal PRN replica is generated in a PRN replica generator 1208. Also, a delayed (and possibly attenuated) version of the same code sequence is generated through a delay element 1210. Then, the two code sequences are added to form a new PRN shape which is correlated to the received signal. If the correlation 1204 response does not peak, an error signal 1212 is sent to the delay element 1210 to further adjust the delay value τ. Through this feedback mechanism, autocorrelation between the received signal and the synthesized PRN may continue until the delay value τ is correct. This τ value represents a physical distance between the direct-path signal and the multipath signal.
[0106] As this process adds another degree of freedom (DOF) (i.e., two-DOF Doppler and code detection instead of one-DOF Doppler in a standard GPS receiver) to the process of identifying the correlation peak, there is additional processing time required to come to a correct solution. Such a process may operate well off-line, where time constraints are not an issue, but could add some delay to a real-time solution.
[0107] In order to address the situation where there may be several multipath components within the received signal, it may be desirable to synthesize a PRN from several delayed codes, each utilizing a different delay T1, T2,... Xn. This can increase the degrees of freedom and the computational burden rapidly if there are a number of multipath components with signal strengths comparable to the direct signal.
[0108] It will therefore be seen that the foregoing represents a highly advantageous approach to mapping a cluttered environment.
[0109] The terms and expressions employed herein are used as terms of description and not of limitation and there is no intention, in the use of such terms and expressions, of excluding any equivalents of the features shown and described or portions thereof, but it is recognized that various modifications are possible within the scope of the invention claimed. For example, although some of the examples presented refer to transceivers sending signals to a tag, one of ordinary skill in the art will recognize that embodiments of the present invention also encompass a tag that sends signals to transceivers, or any combination of transceivers and tags that simultaneously transmit and receive signals to each other. Moreover, Doppler measurements of the multiphase elements are also useful for observing activity elsewhere in the building complex and represent a useful byproduct of geolocation and mapping activity. [0110] Therefore, it must be expressly understood that the illustrated embodiments have been shown only for the purposes of example and should not be taken as limiting the invention, which is defined by the following claims. The following claims are thus to be read as not only literally including what is set forth by the claims but also to include all equivalents that are insubstantially different, even though not identical in other respects to what is shown and described in the above illustrations.
K. Appendix A: Detailed Development of Multipath Solutions
[0111] This appendix presents the basic geometry and multipath solutions appropriate for indoor/urban mapping. The measurement equations required for solving the indoor mapping problem discussed above follow directly from the multipath solutions.
[0112] The following discussion considers the geometry associated with indirect paths having an arbitrary number of specular reflections. The one-way distance from the source to a receiver (e.g., a tag or transponder) is used as a measure of path length. The first case considered is one source and one indirect path, which generalizes trivially to any number of sources and indirect paths.
[0113] The fundamental measurements available to an indoor mapping system are the direct and indirect path lengths. The path identities (i.e., direct and indirect) are unknown and must be inferred from the measurements. It will be assumed throughout this discussion that: the identity and location of all sources is known; the locations and orientations of all reflecting surfaces are unknown; and the number of reflections associated with all indirect paths is unknown. Under these assumptions, determininistic expressions are derived for indirect path length for an arbitrary number of reflections. These expressions form the basis of the measurement equations used by the indoor mapping system.
[0114] The geometry for one specular reflection is shown in FIG. A-I. The source is at known location s and the tag is at unknown location r . The direct path length is
and the (one way) indirect path length is . The unit vectors l
Figure imgf000034_0001
Figure imgf000034_0002
and 2 represent the direction of the incident and reflected signal, u is the unit vector normal to the reflecting plane, and P is the specular point. [0115] The equations describing the multipath geometry for one reflection are:
Figure imgf000035_0001
Figure imgf000035_0004
Figure imgf000035_0005
Figure imgf000035_0002
[0116] From (A.I) and (A.2):
Figure imgf000035_0003
[0117] From (A.1) and (A.4):
Figure imgf000035_0010
so that:
Figure imgf000035_0006
Using
Figure imgf000035_0007
the result is
Figure imgf000035_0008
so that:
Figure imgf000035_0009
Figure imgf000036_0004
[0118] The geometry for two specular reflections is shown in FIG. A-2. The equations describing this multipath geometry are:
Figure imgf000036_0001
[0119] From (A.9) and (A.10):
Figure imgf000036_0002
and from (A.9) and (A.13):
Figure imgf000036_0003
[0120] From (A.12), and using the result is
Figure imgf000037_0004
Figure imgf000037_0005
Figure imgf000037_0001
. Thus:
Figure imgf000037_0003
[0121] Now letting the result is
Figure imgf000037_0006
Figure imgf000037_0007
so that:
Figure imgf000037_0008
[0122] Based on (A.8) and (A.19), it can be hypothesized that the indirect path length for m specular reflections is:
Figure imgf000037_0002
where
Figure imgf000037_0009
[0123] This is now demonstrated by induction to be true. The relevant equations are:
Figure imgf000038_0001
[0124] From (A.22) and (A.26):
Figure imgf000038_0002
[0125] Thus:
Figure imgf000038_0003
[0126] From (A.24) and (A.25):
Figure imgf000039_0003
Thus:
Figure imgf000039_0001
[0127] And from (A.22) and (A.23):
Figure imgf000039_0004
Thus:
Figure imgf000039_0002
[0128] Continuing:
Figure imgf000040_0001
[0129] By induction, it is apparent from (A.30), (A.34) and (A.35) that:
Figure imgf000040_0002
[0130] The case of particular interest is k=1 , which gives:
Figure imgf000040_0003
and verifies the hypothesis posed in (A.21). Note that the direct path length for any number of reflections may be written as:
Figure imgf000041_0001
where w is the unit vector along the ray from the last reflecting surface and c is a constant that depends on the source location, the unit vector along the ray from the source to the first reflecting plane, all of the reflection angles, and all of the reflecting plane locations.
[0131] Equation (A.38) forms the basis of the measurement equations used in the indoor mapping system. It is worth noting that (A.38) is a phenomenological model of the indirect path length that explicitly contains exactly four indirect path parameters ι w' c* for any number of reflections. This implies that mapping using indirect path measurements can be accomplished if the four indirect path parameters associated with the current measurement are known or can be estimated with sufficient accuracy. Moreover, the four indirect path parameters are not independent, since w is uniquely defined by two angles. Thus, the phenomenological model of indirect path length actually contains three independent parameters.
[0132] To simulate the performance of the indoor mapping system, the full solution associated with all indirect paths is calculated in the simulation. Within the simulation, the tag
. , , ,
Figure imgf000041_0004
. . location r is known, and the locations , orientations
Figure imgf000041_0003
, and sizes of all reflecting surfaces are known. With this information, it is possible to determine the full indirect path solutions under the assumption that the sequence of reflections (i.e., the identity of the reflecting planes in sequence) is known. For the simulations used in the preliminary feasibility analysis, this assumption will always hold. In the more general case, ray tracing (which typically requires considerably more computing resources) may be used.
[0133] For one reflection, we have, from (A.3) and (A.6):
Figure imgf000041_0002
[0134] The full solution is found as follows. First calculate:
Figure imgf000042_0001
[0135] Then:
Figure imgf000042_0002
[0136] For two reflections, we have, from (A.11) and (A.16):
Figure imgf000042_0003
[0137] Setting
Figure imgf000042_0004
:
Figure imgf000042_0005
[0138]T Then, setting
Figure imgf000042_0006
T
Figure imgf000042_0007
Figure imgf000043_0003
[0139] The full solution for two reflections is found as follows. First calculate:
Figure imgf000043_0004
[0140] Then:
Figure imgf000043_0001
and the specular points are found using (A.9). [0141] For m reflections, the relevant equations are:
Figure imgf000043_0005
along with (A.31) and (A.33). Then:
using
Figure imgf000043_0002
Figure imgf000044_0001
[0142] Continuing:
Figure imgf000044_0002
[0143] From (A.50), (A.51) and (A.52), we have, by induction:
Figure imgf000045_0001
where
Figure imgf000045_0002
and Mm+1 = I . One case of interest is k = 1 for which:
Figure imgf000045_0003
[0144] The full solution is found as follows. First calculate:
Figure imgf000045_0004
[0145] Then calculate:
Figure imgf000045_0005
[0146] Then the distances
Figure imgf000045_0007
can be calculated from (A.33), and the
specular points
Figure imgf000045_0006
can be calculated using (A.22). [0147] What is claimed is:

Claims

CLAIMS 1. A method for mapping a structure, the method comprising: detecting, at a receiver, a first wireless signal transmitted directly from a satellite; deriving, from the first wireless signal, a location of the satellite; detecting, at the receiver, a second wireless signal transmitted by the satellite and reflected by a structure; determining a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal; and mapping at least one reflection point associated with the structure, the mapping being based on the TDOA, a location of the receiver, and the location of the satellite.
2. The method of claim 1, wherein deriving the location of the satellite comprises deriving, from the first wireless signal, a code sequence and a data message.
3. The method according to claim 2, further comprising: performing data wiping and coherent integration on the second wireless signal before determining the TDOA.
4. The method according to claim 2, further comprising: detecting a signal having the first wireless signal and the second wireless signal mixed together; synthesizing a replica of the detected signal by varying a first delay applied to the code sequence and mixing the resulting delayed code sequence with the code sequence until the resulting mixed code sequence matches the detected signal; and correlating the replica with the detected signal by varying a second delay applied to the replica until a correlation peak occurs between the delayed replica and the detected signal.
5. The method according to claim 1, wherein a plurality of first wireless signals and a plurality of second wireless signals both originating from one or more satellites are detected, and the method further comprises: isolating, from the pluralities of wireless signals, a subset of wireless signals that originate from a same satellite; and identifying, from the subset of wireless signals, a direct path signal and at least one corresponding multipath signal that has reflected off of the structure.
6. The method according to claim 5, further comprising: determining a delay between the at least one corresponding multipath signal and the direct path signal.
7. A system for mapping a structure, the system comprising: a) a receiver at a known location; and b) one or more signal processing elements operatively coupled to the receiver, wherein the receiver and the signal processing elements are for: i) detecting a first wireless signal transmitted directly from a satellite, ii) deriving, from the first wireless signal, a location of the satellite, iii) detecting a second wireless signal transmitted by the satellite and reflected by a structure, iv) determining a time difference of arrival (TDOA) between the second wireless signal and the first wireless signal, and v) mapping at least one reflection point associated with the structure, the mapping being based on the TDOA, the location of the receiver, and the location of the satellite.
8. The system of claim 7, wherein the receiver and the signal processing elements are further configured to derive, from the first wireless signal, a code sequence and a data message.
9. The system according to claim 8, wherein the receiver and the signal processing elements are further configured to perform data wiping and coherent integration on the second wireless signal before determining the TDOA.
10. The system according to claim 8, wherein the receiver and the signal processing elements are further configured to: i) detect a signal having the first wireless signal and the second wireless signal mixed together; ii) synthesize a replica of the detected signal by varying a first delay applied to the code sequence and mixing the resulting delayed code sequence with the code sequence until the resulting mixed code sequence matches the detected signal; and iii) correlate the replica with the detected signal by varying a second delay applied to the replica until a correlation peak occurs between the delayed replica and the detected signal.
11. The system according to claim 7, wherein a plurality of first wireless signals and a plurality of second wireless signals both originating from one or more satellites are detected, and wherein the receiver and the signal processing elements are further configured to: i) isolate, from the pluralities of wireless signals, a subset of wireless signals that originate from a same satellite; and ii) identify, from the subset of wireless signals, a direct path signal and at least one corresponding multipath signal that has reflected off of the structure.
12. The system according to claim 11, wherein the receiver and the signal processing elements are further configured to determine a delay between the at least one corresponding multipath signal and the direct path signal.
13. A method for mapping a structure, the method comprising: detecting a plurality of wireless signals that comprise at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection; analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal; and generating a map of at least the portion of the structure based on the estimated reflection points.
14. The method according to claim 13, wherein the plurality of wireless signals are received from one or more sources and are detected with at least one receiver.
15. The method according to claim 14, wherein the one or more sources comprise one or more satellites moving in space.
16. The method according to claim 14, wherein the one or more sources comprise at least two transmitters at known terrestrial locations.
17. The method according to claim 14, further comprising: causing the at least one receiver to move along a known trajectory within or near the structure.
18. The method according to claim 14, further comprising: causing the at least one receiver to move along an unknown trajectory within or near the structure; and tracking a location of the at least one receiver.
19. The method according to claim 18, wherein the tracking and the generating take place at substantially the same time and in recursive steps.
20. The method according to claim 13, wherein the analyzing further comprises: processing a multipath signal with a Rake filter to correlate the multipath signal with a corresponding direct path signal; determining a time delay between the multipath signal and the corresponding direct path signal; and estimating one or more parameters associated with a multipath delay model.
21. The method of claim 13, wherein the plurality of wireless signals are transmitted from one or more sources selected from the group consisting of: one or more mobile transmitters and one or more fixed terrestrial transmitters.
22. The method according to claim 13, further comprising: assigning one of the plurality of wireless signals to a corresponding signal path.
23. The method according to claim 13, wherein the analyzing further comprises distinguishing the at least one multipath signal from a corresponding direct-path signal.
24. The method according to claim 13, wherein the analyzing further comprises associating the at least one multipath signal with a corresponding direct-path signal.
25. The method according to claim 13, wherein the generating comprises employing both direct-path signals and multipath signals in the plurality of wireless signals.
26. The method according to claim 13, wherein the analyzing further comprises: iteratively estimating one or more multipath parameters associated with a multipath delay model.
27. The method according to claim 26, wherein the one or more multipath parameters for a multipath signal comprise an angle-of-arrival from a last reflection experienced by the multipath signal.
28. The method according to claim 13, further comprising: distinguishing single-reflection multipath signals from multiple-reflection multipath signals.
29. The method according to claim 13, further comprising: identifying one or more true reflection surfaces responsible for producing the at least one multipath signal based on a statistical inference.
30. The method according to claim 13, further comprising: eliminating one or more erroneous mapping points that result from a proximity effect.
31. A system for mapping a structure, the system comprising: a) at least one receiver for detecting a plurality of wireless signals originating from one or more sources, the plurality of wireless signals comprising at least one multipath signal that has experienced at least one reflection against a portion of a structure prior to the detection; and b) a processor, associated with the at least one receiver, for: i) analyzing the plurality of wireless signals to estimate reflection points for the at least one multipath signal; and ii) generating a map of at least the portion of the structure based on the estimated reflection points.
32. The system according to claim 31, wherein the one or more sources comprise one or more satellites moving in space.
33. The system according to claim 31, wherein the one or more sources comprise at least two transmitters at known terrestrial locations.
34. The system according to claim 31, wherein the at least one receiver moves along a known trajectory within or near the structure.
35. The system according to claim 31, wherein the at least one receiver moves along an unknown trajectory within or near the structure, and the system being further configured to track a location of the at least one receiver.
36. The system according to claim 35, wherein the tracking of the location of the at least one receiver and the generating of the map take place at substantially the same time and in recursive steps.
37. The system according to claim 31, further comprising a Rake filter for processing a multipath signal in order to correlate the multipath signal with a corresponding direct path signal, and wherein the processor is further configured to i) determine a time delay between the multipath signal and the corresponding direct path signal and ii) to estimate one or more parameters associated with a multipath delay model.
38. The system of claim 31, wherein the one or more sources are selected from the group consisting of: one or more mobile transmitters and one or more fixed terrestrial transmitters.
39. The system according to claim 31, wherein the at least one receiver is further configured to assign one of the plurality of wireless signals to a corresponding signal path.
40. The system according to claim 31, wherein the processor is further configured to distinguish the at least one multipath signal from a corresponding direct-path signal.
41. The system according to claim 31, wherein the processor is further configured to associate the at least one multipath signal with a corresponding direct-path signal.
42. The system according to claim 31, wherein the generating of the map is based on both direct-path signals and multipath signals in the plurality of wireless signals.
43. The system according to claim 31, wherein the processor is further configured to iteratively estimate one or more multipath parameters associated with a multipath delay model.
44. The system according to claim 43, wherein the one or more multipath parameters for a multipath signal comprise an angle-of-arrival from a last reflection experienced by the multipath signal.
45. The system according to claim 31, wherein the processor is further configured to distinguish single-reflection multipath signals from multiple-reflection multipath signals.
46. The system according to claim 31, wherein the processor is further configured to identify one or more true reflection surfaces responsible for producing the at least one multipath signal based on a statistical inference.
47. The system according to claim 31, wherein the processor is further configured to eliminate one or more erroneous mapping points that result from a proximity effect.
PCT/US2008/076652 2007-09-18 2008-09-17 Systems and methods for transparency mapping using multipath signals WO2009039161A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US97331407P 2007-09-18 2007-09-18
US60/973,314 2007-09-18
US97751907P 2007-10-04 2007-10-04
US60/977,519 2007-10-04

Publications (2)

Publication Number Publication Date
WO2009039161A2 true WO2009039161A2 (en) 2009-03-26
WO2009039161A3 WO2009039161A3 (en) 2009-07-23

Family

ID=40468742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/076652 WO2009039161A2 (en) 2007-09-18 2008-09-17 Systems and methods for transparency mapping using multipath signals

Country Status (1)

Country Link
WO (1) WO2009039161A2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012146969A1 (en) * 2011-04-28 2012-11-01 Topcon Positioning Systems, Inc. Object detection and position determination by relected global navigation satellite system signals
WO2014039737A1 (en) * 2012-09-07 2014-03-13 Microsoft Corporation Estimating and predicting structures proximate to a mobile device
US9429657B2 (en) 2011-12-14 2016-08-30 Microsoft Technology Licensing, Llc Power efficient activation of a device movement sensor module
US9464903B2 (en) 2011-07-14 2016-10-11 Microsoft Technology Licensing, Llc Crowd sourcing based on dead reckoning
US9470529B2 (en) 2011-07-14 2016-10-18 Microsoft Technology Licensing, Llc Activating and deactivating sensors for dead reckoning
US9832749B2 (en) 2011-06-03 2017-11-28 Microsoft Technology Licensing, Llc Low accuracy positional data by detecting improbable samples
TWI616064B (en) * 2016-11-07 2018-02-21 He Zhong Cheng High-precision analytical method for solving the arrival direction angle by using the arrival phase and time difference of the wave
CN108955677A (en) * 2018-08-02 2018-12-07 苏州中德睿博智能科技有限公司 A kind of topological map creation method based on laser radar and GPS and build map device
WO2018223986A1 (en) * 2017-06-06 2018-12-13 中兴通讯股份有限公司 Positioning method and device
US10184798B2 (en) 2011-10-28 2019-01-22 Microsoft Technology Licensing, Llc Multi-stage dead reckoning for crowd sourcing

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5949364A (en) * 1998-01-06 1999-09-07 The United States Of America As Represented By The Administration Of The National Aeronautics And Space Administration Method and system for producing images of an object
US6150979A (en) * 1998-11-30 2000-11-21 The United States Of America As Represented By The Secretary Of The Air Force Passive ranging using global positioning system
WO2001081941A1 (en) * 2000-04-19 2001-11-01 The Charles Stark Draper Laboratory, Inc. Multipath propagation detection and avoidance method and system
US20020089450A1 (en) * 2000-12-22 2002-07-11 Dowdle John R. Geographical navigation using multipath wireless navigation signals
US6744408B1 (en) * 2003-03-04 2004-06-01 Rockwell Collins Enhancements for GPS based bi-static radar
WO2006088599A1 (en) * 2005-01-19 2006-08-24 The Charles Stark Draper Laboratory, Inc. Systems and methods for positioning using multipath signals

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5949364A (en) * 1998-01-06 1999-09-07 The United States Of America As Represented By The Administration Of The National Aeronautics And Space Administration Method and system for producing images of an object
US6150979A (en) * 1998-11-30 2000-11-21 The United States Of America As Represented By The Secretary Of The Air Force Passive ranging using global positioning system
WO2001081941A1 (en) * 2000-04-19 2001-11-01 The Charles Stark Draper Laboratory, Inc. Multipath propagation detection and avoidance method and system
US20020089450A1 (en) * 2000-12-22 2002-07-11 Dowdle John R. Geographical navigation using multipath wireless navigation signals
US6744408B1 (en) * 2003-03-04 2004-06-01 Rockwell Collins Enhancements for GPS based bi-static radar
WO2006088599A1 (en) * 2005-01-19 2006-08-24 The Charles Stark Draper Laboratory, Inc. Systems and methods for positioning using multipath signals

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8768611B2 (en) 2011-04-28 2014-07-01 Topcon Positioning Systems Inc. Object detection and position determination by reflected global navigation satellite system signals
WO2012146969A1 (en) * 2011-04-28 2012-11-01 Topcon Positioning Systems, Inc. Object detection and position determination by relected global navigation satellite system signals
US9832749B2 (en) 2011-06-03 2017-11-28 Microsoft Technology Licensing, Llc Low accuracy positional data by detecting improbable samples
US9464903B2 (en) 2011-07-14 2016-10-11 Microsoft Technology Licensing, Llc Crowd sourcing based on dead reckoning
US9470529B2 (en) 2011-07-14 2016-10-18 Microsoft Technology Licensing, Llc Activating and deactivating sensors for dead reckoning
US10082397B2 (en) 2011-07-14 2018-09-25 Microsoft Technology Licensing, Llc Activating and deactivating sensors for dead reckoning
US10184798B2 (en) 2011-10-28 2019-01-22 Microsoft Technology Licensing, Llc Multi-stage dead reckoning for crowd sourcing
US9429657B2 (en) 2011-12-14 2016-08-30 Microsoft Technology Licensing, Llc Power efficient activation of a device movement sensor module
CN104620130A (en) * 2012-09-07 2015-05-13 微软公司 Estimating and predicting structures proximate to a mobile device
US9817125B2 (en) 2012-09-07 2017-11-14 Microsoft Technology Licensing, Llc Estimating and predicting structures proximate to a mobile device
WO2014039737A1 (en) * 2012-09-07 2014-03-13 Microsoft Corporation Estimating and predicting structures proximate to a mobile device
CN104620130B (en) * 2012-09-07 2020-02-07 微软技术许可有限责任公司 Estimating and predicting structure of proximate mobile devices
TWI616064B (en) * 2016-11-07 2018-02-21 He Zhong Cheng High-precision analytical method for solving the arrival direction angle by using the arrival phase and time difference of the wave
WO2018223986A1 (en) * 2017-06-06 2018-12-13 中兴通讯股份有限公司 Positioning method and device
CN108955677A (en) * 2018-08-02 2018-12-07 苏州中德睿博智能科技有限公司 A kind of topological map creation method based on laser radar and GPS and build map device

Also Published As

Publication number Publication date
WO2009039161A3 (en) 2009-07-23

Similar Documents

Publication Publication Date Title
US8279119B2 (en) Systems and methods for transparency mapping using multipath signals
US7973716B2 (en) Systems and methods for transparency mapping using multipath signals
WO2009039161A2 (en) Systems and methods for transparency mapping using multipath signals
US7679561B2 (en) Systems and methods for positioning using multipath signals
Gentner et al. Indoor positioning using time difference of arrival between multipath components
US9958549B2 (en) Methods and apparatus for detecting spoofing of global navigation satellite system signals using carrier phase measurements and known antenna motions
Zekavat et al. Handbook of position location: Theory, practice and advances
Ascher et al. Integrity monitoring for UWB/INS tightly coupled pedestrian indoor scenarios
Kulmer et al. Anchorless cooperative tracking using multipath channel information
EP2952925A1 (en) Method, device and system for indoor localization and tracking using ultra-wideband radio signals
Toth et al. Positioning slow-moving platforms by UWB technology in GPS-challenged areas
Aernouts et al. Combining TDoA and AoA with a particle filter in an outdoor LoRaWAN network
US9035762B2 (en) Method and system for locating signal emitters using cross-correlation of received signal strengths
Ogiso et al. Robust indoor localization in a reverberant environment using microphone pairs and asynchronous acoustic beacons
Gustafson et al. Innovative indoor geolocation using RF multipath diversity
Gentner Channel-SLAM: Multipath assisted positioning
Algeier et al. State space initiation for blind mobile terminal position tracking
US9274208B2 (en) Enhanced RF location methods and systems
Banerjee Improving accuracy in ultra-wideband indoor position tracking through noise modeling and augmentation
Miekk-oja Static beacons based indoor positioning method for improving room-level accuracy
Blois et al. Baseline Spoofing Detection for Aircraft with Standard Navigation Hardware
Gentner et al. Simultaneous localization and mapping in multipath environments: mapping and reusing of virtual transmitters
Jansen Detection and localization of attacks on satellite-based navigation systems
Zhong Asymmetric Positioning for NLOS Mitigation
Cho et al. Self-positioning fusion system based on estimation of relative coordinates

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08832672

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08832672

Country of ref document: EP

Kind code of ref document: A2