uint64 Numeric Limit Step

[NikolajEgeskovOstergaard]

How do i use UInt64 in a numeric limit step.

TS says "expected Number found Number {UInt64}.

If i change the Numeric format for the limits to UInt, my limit values are modified. I can't select UInt64 as Numeric format. My DataSource format is UInt64.

br

Nikolaj

[NikolajEgeskovOstergaard]

It works if i convert my UInt64 to Float64...

is that really it ?

[dug9000 · Accepted solution]

---

@NikolajEgeskovOstergaard wrote:

It works if i convert my UInt64 to Float64...

is that really it ?

---

I would advise against doing that. Not all UInt64 values can be exactly represented in a Float64 so you will get some rounding error. It depends on what you are doing whether or not that would matter.

The numeric limit step does not currently support 64-bit integers, however the CheckLimits() expression function does support them so you could do something like:

Step.Result.Status = CheckLimits(Locals.Measured, Locals.High, Locals.Low, "GELE", False)

Also you might want to post a feature request to:

http://forums.ni.com/t5/NI-TestStand-Idea-Exchange/idb-p/teststandideas

Hope this helps,

-Doug