0

Rounding inconsistently

[edit to add that the other rows with serial numerals != 5 are rounding as expected]

 

I have a source file with text values ( "text" column in the picture ) - I use a formula column to return a double ( "Decimal - No format" in the picture )

 

formula column: 

=================

double(    substring(        __Rounding_Issue.Turnover.ColumnName,         0,         (length(            __Rounding_Issue.Turnover.ColumnName        ) - 1)    )

) / 100

===============

 

What I want to do is display this as percent rounded but what I'm finding is that a 147.50 displays as 148%   but 174.50 displays as 174%  ( "Decimal - percent rounded" in picture ).

 

I know there are some specialized situations when analyzing a large body of numbers requires alternating the rounding rulesfor the serial "5" but that's definitely not what I'm expecting in my dashboard.

 

I'll appreciate any insight. 

3replies Oldest first
  • Oldest first
  • Newest first
  • Active threads
  • Popular
  • Hi Randy, please open a support ticket for this scenario as I believe there is an engineering initiative related to this and you'll want to get the latest details. At root I suspect this is related to the use of a Double data type which is a floating point precision type; hence, when persisting this column during data load, it could be 174.500000000001 or 174.49999999999 as an example.

    Like
  • Thanks Dustin - I have a ticket open and had requested it to be elevated ( it has ).   

     

    I provided a text file source, schema and dashboard exports as well so it should be replicable.

    Like
  • Adding - this isn't the same, but similar, and exposing very small numbers in the UI would be a good thing.

     

    Anyone reading - how about an upvote  ;-) 

     

    https://community.incorta.com/t/35hx5hl/expose-very-small-numbers-in-interface-and-be-consistent-in-internal-use

    Like 1
Like Follow
  • 13 days agoLast active
  • 3Replies
  • 20Views
  • 2 Following

Product Announcement

Incorta 2014.2 is now available!