57.8.4.4 Gain and Offset Errors

For:

a given gain error: E_G (%)
a given ideal code (C_i)
a given offset error: E_O (LSB of 12 bits)

in 12-bit mode, the actual code (C_A) is calculated using the following formula

C_{A} = (1 + \frac{E_{G}}{100}) \times (C_{i} - 2047) + 2047 + E_{O}

For higher resolutions, the code can be extended to the corresponding resolution defined by RES.

The online versions of the documents are provided as a courtesy. Verify all content and data in the device’s PDF documentation found on the device product page.