OSC20M Stored Frequency Error Compensation

This oscillator can operate at multiple frequencies, selected by the value of the Frequency Select (FREQSEL) bits in the Oscillator Configuration (FUSE.OSCCFG) fuse at Reset. As previously mentioned, appropriate calibration values are loaded to adjust to center frequency (OSC20M) and temperature drift compensation (TEMPCAL20M), meeting the specifications defined in the internal oscillator characteristics. For applications requiring a wider operating range, the relative factory stored frequency error after calibrations can be used. The four errors are measured with different settings and are available in the signature row as signed byte values.

The error is stored as a compressed Q1.10 fixed point 8-bit value, not to lose resolution, where the MSb is the sign bit, and the seven LSbs are the lower bits of the Q1.10.


The minimum legal BAUD register value is 0x40. The target BAUD register value must, therefore, not be lower than 0x4A to ensure that the compensated BAUD value stays within the legal range, even for parts with negative compensation values. The example code below demonstrates how to apply this value for a more accurate USART baud rate:

  #include <assert.h> 
  /* Baud rate compensated with factory stored frequency error  */
  /* Asynchronous communication without Auto-baud (Sync Field)  */
  /* 16MHz Clock, 3V and 600 BAUD                               */

  int8_t  sigrow_val    = SIGROW.OSC16ERR3V;    // Read signed error
  int32_t baud_reg_val  = 600;                  // Ideal BAUD register value
  assert (baud_reg_val >= 0x4A);                // Verify legal min BAUD register value
  baud_reg_val *= (1024 + sigrow_val);          // Sum resolution + error
  baud_reg_val /=  1024;                        // Divide by resolution
  USART0.BAUD = (int16_t) baud_reg_val;         // Set adjusted baud rate