lib: improve raw_to_uv approximation

By postponing the division to improve the accuracy Signed-off-by: Federico Vaga <federico.vaga@cern.ch>

lib: improve raw_to_uv approximation
By postponing the division to improve the accuracy Signed-off-by: Federico Vaga <federico.vaga@cern.ch>
de8f8d25 · Federico Vaga · 05357315 · de8f8d25
Commit de8f8d25 authored Mar 18, 2022 by Federico Vaga
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

fmc-adc-100m14b4cha.c lib/fmc-adc-100m14b4cha.c +1 -1

No files found.
--- a/lib/fmc-adc-100m14b4cha.c
+++ b/lib/fmc-adc-100m14b4cha.c
@@ -493,7 +493,7 @@ static uint32_t __offset_raw_to_uv(uint32_t value_raw)
 {
 	int32_t value_raw_s = (int32_t)value_raw;

-	return (value_raw_s * (ADC_100M14B4CHA_DAC_VREF_uV / 0x8000LL)) - ADC_100M14B4CHA_DAC_VREF_uV;
+	return ((value_raw_s * ADC_100M14B4CHA_DAC_VREF_uV) / 0x8000LL) - ADC_100M14B4CHA_DAC_VREF_uV;
 }