History
The science of measurement from stereoscopic imagery (photogrammetry) has existed for almost as long as photography itself, described by German Architect Albrecht Meydenbauer as early as 1867. Photogrammetry and remote sensing have evolved along with technological innovation in sensors, lenses, spectral sensitivity, and computer vision, enabling use across many disciplines such as traditional mapping, civil engineering, through medical imaging, and real-time automation.
In aerial photography for traditional mapping applications, photogrammetry adapted to cartographic standards, favoring coordinate systems designed for 2D representations of the Earth’s curved surface. Local Space Rectangular (LSR) coordinate systems became standard for transforming GPS-based global coordinates (e.g., WGS84) into a local Cartesian frame suitable for generating 2D map products like orthophotos and digital elevation models. These systems project a curved portion of the Earth onto a flat surface, assuming a local, planar approximation.
Limitations of Local Space Rectangular Systems
While LSR systems worked well for small nadir-only projects aligned with 2D ground control grids, they become increasingly problematic when applied over larger geographic areas with more oblique imagery.
Misalignment Between Photogrammetric and Geodetic Networks
The primary challenge lies in the flat-Earth assumption inherent in LSR systems. This assumption becomes increasingly inaccurate with distance from the projection origin, especially in wide-area surveys and projects using oblique imagery. As coverage expands, distortion increases both horizontally and vertically, degrading positional accuracy.
These inaccuracies stem from misalignments between the geodetic and photogrammetric networks, where the quality of the photogrammetric network—formed through image correlation—is intrinsically more accurate than the geodetic control system to which it is tied.
To address this issue, bundle adjustment was introduced as a method for improving spatial accuracy. Bundle adjustment is a mathematical optimization technique used in photogrammetry to simultaneously refine the 3D coordinates of object points and the parameters of the camera (position and orientation), by minimizing the reprojection error between observed and predicted image points across multiple overlapping photographs.
However, when applied to large-scale datasets, bundle adjustment faced limitations due to the influence of imprecise control points. As a refinement, the concept of a “free network” gained traction. In this approach, the initial bundle adjustment is performed without geodetic control, enabling the internal geometry of large image blocks to be solved independently, with minimal error propagation. This leads to more consistent results across the image network.
Inherent Geometric Distortions in LSR
While the free network approach significantly improves internal accuracy, it still relies on an LSR coordinate framework that does not inherently model Earth's curvature. As a result, it remains constrained by the limitations of projecting 3D relationships onto a 2D plane. This is particularly problematic for modern photogrammetric workflows that require high-precision 3D reconstruction.
These distortions become especially evident in 3D triangulation using oblique imagery. Because LSR systems assume a flat Earth, they do not account for curvature, introducing small but significant errors. For example, at a 45-degree oblique angle from 1,500 meters altitude, Earth curvature causes a deviation of about 0.18 meters between the expected and actual ground footprint, affecting both Z positioning and the angles between image rays.
Triangulating in an LSR system also enforces parallel Z-up vectors, which should instead be radially aligned to Earth’s center (e.g., in ECEF). This misalignment distorts spatial relationships between image stations and the ground.
Visualizing LSR Errors with Oblique Imagery
The figure below illustrates how uncurving the Earth in LSR bends light rays from oblique cameras (red line), while triangulation still occurs along straight paths (orange line). To align pixels from multiple oblique images with a shared ground point, the curved ray must be shortened to match the flat model—an adjustment that introduces error into the bundle solution.
This growing need for geometric fidelity in aerial triangulation raises a fundamental question: what type of coordinate system can preserve true 3D spatial relationships over large areas? The answer lies in Earth-centered coordinate systems that align more naturally with the planet’s shape and rotational dynamics.
Coordinate Systems for Accurate Surface Modeling
Earth-Centered, Earth Fixed (ECEF)
ECEF is a 3D Cartesian coordinate system in which all positions are defined relative to the Earth's center of mass. Unlike LSR systems, which flatten Earth's surface for local approximation, ECEF preserves Earth's curvature, enabling precise global positioning without distortion. The axes are defined as follows
- X axis lies on the equatorial plane and points from the Earth’s center toward the intersection of the Equator and the Prime Meridian.
- Y axis lies on the equatorial plane; it is perpendicular to the X axis, and points from the Earth’s center toward the intersection of the Equator and 90 degrees East longitude.
- Z axis is perpendicular to the equatorial plane and points from the Earth’s center toward the North Pole.
The coordinate system rotates with the Earth, which means positions in ECEF remain fixed relative to the Earth's surface. This characteristic ensures consistency with Global Navigation Satellite Systems (GNSS), such as GPS, which use ECEF as their foundational reference frame.
ECEF coordinates are directly compatible with geodetic systems (latitude, longitude, altitude), enabling straightforward transformations between coordinate types.
Although ECEF offers global consistency and avoids projection distortion, it involves very large numerical values that require high-precision computations, making direct calculations more complex and potentially resource-intensive.[3]
To address this, ECEF is often used in conjunction with a more intuitive local reference frame, such as East-North-Up (ENU), which enables localized processing while maintaining global consistency.
East-North-Up (ENU)
ENU is a local Cartesian coordinate system that allows for smaller units and a more intuitive reference frame for 3D calculations near a specific point on the Earth's surface. It is derived from the global ECEF system by defining a local origin —typically the center of the mapping project—and aligning a tangent plane to the Earth's surface at that point. The resulting ENU axes are:
- X (East): tangent to the surface pointing east
- Y (North): tangent to the surface pointing north
- Z (Up): perpendicular to the surface, pointing away from the Earth's center
The transformation from ECEF to ENU translates global coordinates into a local frame, simplifying multi-ray triangulation and 3D transformations used in photogrammetry. Since ENU is tied to a specific point on the Earth's surface, it enables precise local modeling without introducing the large numerical values associated with global systems.
Converting from ECEF to ENU
Converting from the Earth-Centered, Earth-Fixed (ECEF) coordinate system to the East-North-Up (ENU) coordinate system involves the following steps:
- Define the Reference Point: Select a reference point on the Earth's surface—typically the center of the 3D mesh project—defined by its geodetic coordinates (latitude, longitude, and altitude). This point becomes the origin of the ENU coordinate system.
- Convert Reference Point to ECEF: Convert the reference point's geodetic coordinates to ECEF coordinates (X, Y, Z).
- Calculate the Rotation Matrix: Compute the rotation matrix based on the latitude and longitude of the reference point. This matrix aligns the ECEF global coordinate system axes with the local ENU axes (east, north, up).
- Apply the Rotation Matrix: For any point in ECEF coordinates, subtract the ECEF coordinates of the reference point to get the relative position. Then, apply the rotation matrix to this relative position to obtain the ENU coordinates.
ENU and ECEF in Skyline Software
By using ENU as a surface-aligned projection derived from ECEF, PhotoMesh is able to perform bundle adjustment and 3D reconstruction in a true spatial frame. This approach offers several key advantages. First, it preserves Earth’s curvature by aligning all spatial relationships to the geoid—allowing triangulation to occur on a concentric 3D surface rather than a flat 2D projection. This results in true Euclidean relationships between image stations and ground points.
Because GPS coordinates are inherently in ECEF, they can be directly incorporated into the triangulation process. This reduces transformation overhead and improves geospatial alignment. Furthermore, ENU/ECEF geometry accurately models the real angles of image rays (red lines in figure below), including those from oblique imagery, which is critical for dense pixel correlation and 3D mesh fidelity. With ENU/ECEF, the triangulation occurs along straight paths (orange line), forming a 1:1 relationship to the image ray path (red line).
Legacy photogrammetric systems used LSR which is typically accurate only in the XY plane and distort as elevation increases due to the underlying 2D projection. These systems require artificial corrections—such as “Earth Curvature Correction”—to approximate reality. By contrast, PhotoMesh builds Earth curvature directly into the ENU projection derived from the ECEF system, eliminating the need for such adjustments.
This native modeling of curvature allows for more accurate and scalable reconstruction. It ensures low residual errors across large projects—up to tens or hundreds of thousands of images—by maintaining consistent geometry throughout the AT solution.
Conclusion
By leveraging the strengths of both ECEF and ENU coordinate systems, Skyline PhotoMesh delivers a geospatial framework that preserves true 3D spatial relationships over large areas. ECEF provides a globally consistent, curvature-preserving reference system aligned with GPS and geodetic coordinates, while ENU offers a locally aligned projection ideal for precise aerotriangulation and 3D mesh reconstruction. Together, they eliminate the distortion and approximation inherent in legacy LSR systems, especially in projects involving oblique imagery or wide geographic extents. This integrated approach ensures high-accuracy modeling, efficient computation, and scalable photogrammetric solutions.
References and Further Reading:
Albrecht Meydenbauer (1867) – Die Photometrographie
Early foundational work describing stereoscopic measurement from photography and the origins of photogrammetry.Triggs et al. (2000) – Bundle Adjustment: A Modern Synthesis
Authoritative explanation of bundle adjustment, free networks, and large-scale photogrammetric optimization.MathWorks Documentation – Comparison of 3-D Coordinate Systems
Overview of ECEF, ENU, and related Earth-centered and local spatial reference frames.Wikimedia Commons – ECEF–ENU–Latitude–Longitude Relationships
Diagrams illustrating geometric relationships between global and local coordinate systems.