Questions tagged [floating-point]

19

votes

7

answers

What happens in C++ when an integer type is cast to a floating point type or vice-versa?

asked 2010-01-11T18:56:15.343

63

votes

5

answers

Set the display precision of a float in Ruby

ruby floating-point precision

asked 2009-12-19T19:49:51.543

52

votes

6

answers

What is the range of values a float can have in Python?

python floating-point

asked 2009-12-02T21:02:28.323

9

votes

2

answers

Haskell minimum/maximum Double Constant

haskell floating-point constants

asked 2009-11-23T00:04:24.100

11

votes

4

answers

Python float - str - float weirdness

python string floating-point floating-accuracy ieee-754

asked 2009-11-22T10:28:18.340

71

votes

12

answers

What is the maximum length in chars needed to represent any double value?

c++ c floating-point

asked 2009-11-09T13:43:07.917

379

votes

11

answers

What is the rationale for all comparisons returning false for IEEE754 NaN values?

floating-point comparison nan ieee-754 iec10967

asked 2009-10-14T09:19:17.417

14

votes

4

answers

Why doesn't this crash? Aren't I dividing by zero here?

objective-c c crash floating-point

asked 2009-09-19T18:00:39.297

71

votes

10

answers

Formatting doubles for output in C#

c# formatting floating-point ieee-754

asked 2009-09-14T13:23:38.397

10

votes

3

answers

Haskell converting Float to Int

haskell floating-point int

asked 2009-09-09T01:58:45.933

92

votes

4

answers

Converting a float to a string without rounding it

python string floating-point rounding

asked 2009-08-23T02:03:07.717

30

votes

8

answers

Selecting a float in MySQL

php mysql floating-point database

asked 2009-08-19T19:48:51.667

40

votes

7

answers

How to use expr on float?

bash floating-point rounding fixed-point

asked 2009-08-10T09:48:55.330

13

votes

11

answers

Is relational comparison between int and float directly possible in C?

c floating-point comparison equality

asked 2009-07-21T19:22:00.157

12

votes

9

answers

PHP - Serialize floating points

php serialization random floating-point

asked 2009-07-10T13:34:29.377

29

votes

8

answers

Ruby round float to_int if whole number

ruby floating-point int

asked 2009-07-03T00:27:16.730

13

votes

6

answers

What do these three special floating-point values mean: positive infinity, negative infinity, NaN?

java floating-point nan infinity

asked 2009-06-17T14:58:12.930

14

votes

6

answers

Comparing two matrices in Matlab

matlab comparison floating-point matrix

asked 2009-06-02T07:06:51.380

91

votes

8

answers

What range of numbers can be represented in 16-, 32-, and 64-bit IEEE-754 systems?

floating-point precision numeric ieee-754

asked 2009-05-16T14:37:41.893

14

votes

1

answers

What does floating point error -1.#J mean?

c++ c floating-point printf

asked 2009-05-08T14:32:48.170

303

votes

12

answers

When should I use double instead of decimal?

c# types floating-point double decimal

asked 2009-04-29T16:38:21.710

211

votes

11

answers

What's the difference between a single precision and double precision floating point operation?

floating-point precision processor operations

asked 2009-04-29T06:30:19.177

25

votes

4

answers

Representing integers in doubles

c math floating-point precision ieee-754

asked 2009-04-17T06:00:44.010

19

votes

3

answers

Why is floating point arithmetic in C# imprecise?

c# floating-point

asked 2009-04-15T22:12:57.763

75

votes

5

answers

Why is 24.0000 not equal to 24.0000 in MATLAB?

matlab floating-point precision

asked 2009-03-26T16:10:38.863

9

votes

3

answers

Absolute value for floats in core OCaml

floating-point ocaml absolute-value

asked 2009-03-20T17:37:56.207

37

votes

8

answers

Good way to hash a float vector?

floating-point hashtable hash

asked 2009-03-16T12:18:26.210

2498

votes

19

answers

Difference between decimal, float and double in .NET?

.net floating-point double decimal

asked 2009-03-06T11:31:23.103

294

votes

10

answers

When should I use the "strictfp" keyword in java?

java floating-point strictfp

asked 2009-02-05T21:08:34.197

12

votes

2

answers

How do you calculate div and mod of floating point numbers?

perl math floating-point division modulo

asked 2009-01-30T06:52:21.247

21

votes

14

answers

Floating Point to Binary Value(C++)

c++ binary floating-point ieee-754

asked 2009-01-23T18:45:28.580

11

votes

2

answers

What are coding conventions for using floating-point in Linux device drivers?

linux floating-point linux-device-driver fxsave

asked 2009-01-10T15:05:28.497

19

votes

15

answers

How to speed up floating-point to integer number conversion?

c++ c performance optimization floating-point

asked 2009-01-09T20:38:19.527

54

votes

9

answers

Java double comparison epsilon

java floating-point currency

asked 2008-12-10T17:11:15.083

38

votes

10

answers

Truncate Decimal number not Round Off

.net floating-point truncate

asked 2008-12-01T03:31:54.243

31

votes

10

answers

How deterministic is floating point inaccuracy?

c# math silverlight floating-point deterministic

asked 2008-11-30T08:11:54.757

20

votes

11

answers

Can every float be expressed exactly as a double?

java floating-point

asked 2008-11-03T15:39:40.747

68

votes

8

answers

How do I round a number in JavaScript?

javascript floating-point numbers rounding

asked 2008-10-29T09:14:21.250

33

votes

6

answers

Using NaN in C++?

c++ floating-point nan

asked 2008-10-24T21:56:22.533

11

votes

5

answers

ParseFloat function in JavaScript

javascript floating-point parsefloat

asked 2008-10-06T11:06:31.257

24

votes

7

answers

When to use Fixed Point these days

optimization floating-point performance numerical fixed-point

asked 2008-10-05T02:53:37.087

56

votes

10

answers

Are doubles faster than floats in C#?

c# performance floating-point precision

asked 2008-10-01T17:58:46.337

21

votes

6

answers

Where can I find the world's fastest atof implementation?

c++ c performance assembly floating-point

asked 2008-09-19T01:17:55.317

9

votes

9

answers

Determine if a string is an integer or a float in ANSI C

c floating-point numbers

asked 2008-09-16T23:55:42.190

9

votes

15

answers

Comparing IEEE floats and doubles for equality

variables floating-point inequality

asked 2008-08-21T21:47:24.230

23

votes

10

answers

A little diversion into floating point (im)precision, part 1

math language-agnostic floating-point

asked 2008-08-04T06:21:38.293

Questions tagged floating-point