Questions tagged [floating-point]

34

votes

4

answers

PHP float calculation error when subtracting

asked 2013-06-20T10:02:08.047

77

votes

9

answers

How to get the sign, mantissa and exponent of a floating point number

c floating-point emulation

asked 2013-03-28T15:00:54.057

27

votes

4

answers

How to detect double precision floating point overflow and underflow?

c++ floating-point

asked 2013-03-27T09:06:26.747

9

votes

1

answers

Range of integers that can be expressed precisely as floats / doubles

c# java floating-point integer double

asked 2013-03-26T17:00:34.510

16

votes

2

answers

Check two float/double values for exact equality

java floating-point

asked 2013-03-22T14:22:49.047

12

votes

2

answers

Way to get floating-point special values in CUDA?

cuda floating-point nvidia nan

asked 2013-03-20T02:37:37.640

8

votes

1

answers

Accuracy of floating point arithmetic

c floating-point floating-accuracy ieee-754

asked 2013-03-15T19:59:53.103

8

votes

1

answers

TypeError: a float is required

python types floating-point

asked 2013-02-21T13:24:22.403

8

votes

5

answers

checking if a number is float in PHP

php validation floating-point

asked 2013-02-14T02:08:53.337

47

votes

2

answers

Coercing floating-point to be deterministic in .NET?

c# .net floating-point ieee-754 non-deterministic

asked 2013-02-13T22:15:12.257

9

votes

8

answers

Java's '==' operator on doubles

java floating-point equals-operator

asked 2013-02-06T16:58:34.313

18

votes

7

answers

Converting float decimal to fraction

php math floating-point type-conversion rational-numbers

asked 2013-01-15T03:29:09.303

11

votes

2

answers

Find the float just below a value

c# floating-point

asked 2013-01-11T12:29:57.533

14

votes

4

answers

Floating-point arithmetic in UNIX shell script

shell unix math floating-point

asked 2013-01-08T19:07:41.933

9

votes

4

answers

sqrt, perfect squares and floating point errors

c haskell floating-point

asked 2013-01-04T05:45:55.887

30

votes

1

answers

Modulus/Remainder function for non-integers

haskell floating-point modulo

asked 2012-12-25T05:07:48.627

33

votes

4

answers

What is this "denormal data" about ? - C++

c++ floating-point cpu denormal-numbers subnormal-numbers

asked 2012-12-22T10:07:41.983

8

votes

2

answers

Performance of different math functions in x86?

c++ performance math floating-point

asked 2012-12-12T19:30:28.970

10

votes

6

answers

Real numbers - how to determine whether float or double is required?

c++ c floating-point

asked 2012-11-29T07:03:50.333

9

votes

4

answers

Integer type with floating point semantics for C or D

c floating-point int d fixed-point

asked 2012-11-24T18:18:52.997

10

votes

5

answers

Does float always auto-convert to double when multiplying mixed data types?

c floating-point type-promotion

asked 2012-11-16T21:56:33.787

8

votes

2

answers

Can C#/.net parse exponential hex encoded floating point numbers from strings?

c# .net parsing floating-point

asked 2012-11-15T00:59:35.710

10

votes

4

answers

Explain why the hidden bit of floating point format does not need to be represented

floating-point

asked 2012-10-25T07:55:45.793

10

votes

4

answers

Number of significant digits for a floating point type

c floating-point floating-point-conversion

asked 2012-10-10T08:34:05.403

31

votes

2

answers

C++ float array initialization

c++ arrays floating-point initialization

asked 2012-10-08T22:12:28.260

12

votes

3

answers

what is the best way to avoid negative zero in output?

c++ floating-point cout

asked 2012-09-21T18:35:34.570

19

votes

7

answers

Encoding int value as an IEEE-754 float (binary32)

c floating-point bit-manipulation bitwise-operators

asked 2012-09-09T20:57:32.553

10

votes

1

answers

Why is there GLint and GLfloat?

class opengl floating-point int primitive-types

asked 2012-09-07T22:52:14.890

9

votes

6

answers

How can I detect if a float has a repeating decimal expansion in C#?

c# math floating-point design-patterns period

asked 2012-08-23T19:10:08.740

63

votes

2

answers

Getting the actual, floating-point width of an element

jquery css floating-point width

asked 2012-08-10T18:46:46.303

13

votes

3

answers

python datetime.strptime: ignore fraction of a second

datetime floating-point format python-2.7

asked 2012-07-02T22:28:19.387

10

votes

7

answers

In C and Objective-C, what really is the right way to truncate a float or double to an integer?

objective-c c floating-point floating-accuracy

asked 2012-06-28T12:31:52.173

15

votes

3

answers

SQL set floating point precision

sql floating-point precision truncate

asked 2012-06-20T19:19:58.987

13

votes

3

answers

Printing very large floating point numbers

c++ c floating-point standards printf

asked 2012-06-10T17:00:08.953

13

votes

2

answers

Does setprecision in c++ round? If so why am I seeing this?

c++ floating-point

asked 2012-06-06T21:11:51.327

8

votes

3

answers

Ruby Floating Point Math - Issue with Precision in Sum Calc

ruby-on-rails ruby validation math floating-point

asked 2012-05-28T13:29:40.007

31

votes

8

answers

Why aren't rational numbers implemented and stored as fractions with zero loss of information?

c++ floating-point numbers

asked 2012-05-27T03:21:43.400

16

votes

3

answers

How do you get the next value in the floating-point sequence?

python math floating-point

asked 2012-05-02T20:05:42.493

25

votes

3

answers

Problems casting NAN floats to int

c floating-point nan

asked 2012-04-28T18:44:59.083

21

votes

2

answers

Converting from double to float in Java

java floating-point double type-conversion

asked 2012-04-09T14:53:22.793

16

votes

1

answers

How do I overload `float()` for a custom class?

python floating-point operator-overloading overloading

asked 2012-04-05T18:39:27.953

32

votes

5

answers

Modern x86 cost model

performance assembly x86 floating-point micro-optimization

asked 2012-03-31T15:01:55.043

11

votes

4

answers

Precision in C floats

c floating-point precision

asked 2012-03-19T06:09:30.187

23

votes

4

answers

Floating Point Modulo Operation

c assembly binary floating-point modulo

asked 2012-02-29T19:38:13.100

15

votes

4

answers

Is indexing of Data.Vector.Unboxed.Mutable.MVector really this slow?

performance haskell vector profiling floating-point

asked 2012-02-23T08:44:52.170

9

votes

4

answers

Fast float to int conversion (truncate)

c optimization floating-point data-conversion truncate

asked 2012-02-18T22:22:26.650

9

votes

4

answers

How to check a double's bit pattern is 0x0 in a C++11 constexpr?

c++ casting c++11 floating-point constexpr

asked 2012-02-17T12:31:03.943

1685

votes

7

answers

Why does changing 0.1f to 0 slow down performance by 10x?

c++ performance visual-studio-2010 compilation floating-point

asked 2012-02-16T15:58:39.667

10

votes

4

answers

Determining Floating Point Square Root

algorithm math floating-point computer-science

asked 2012-02-10T22:04:55.220

9

votes

1

answers

Why floating calculation and casting shows different result in debug and release configuration?

c++ c visual-c++ floating-point

asked 2012-02-10T18:32:25.137

Questions tagged floating-point