Search Results

Search found 950 results on 38 pages for 'floating'.

Page 1/38 | 1 2 3 4 5 6 7 8 9 10 11 12  | Next Page >

• Floating point precision in Visual C++

  - by Luigi Giaccari

  HI, I am trying to use the robust predicates for computational geometry from Jonathan Richard Shewchuk. I am not a programmer, so I am not even sure of what I am saying, I may be doing some basic mistake. The point is the predicates should allow for precise aritmthetic with adaptive floating point precision. On my computer: Asus pro31/S…

  Read the article

• ray collision with rectangle and floating point accuracy

  - by phq

  I'm trying to solve a problem with a ray bouncing on a box. Actually it is a sphere but for simplicity the box dimensions are expanded by the sphere radius when doing the collision test making the sphere a single ray. It is done by projecting the ray onto all faces of the box and pick the one that is closest. However because I'm using…

  Read the article

• Floating point equality and tolerances

  - by doron

  Comparing two floating point number by something like a_float == b_float is looking for trouble since a_float / 3.0 * 3.0 might not be equal to a_float due to round off error. What one normally does is something like fabs(a_float - b_float) < tol. How does one calculate tol? Ideally tolerance should be just larger than the value…

  Read the article

• Floating point inaccuracy examples

  - by David Rutten

  How do you explain floating point inaccuracy to fresh programmers and laymen who still think computers are infinitely wise and accurate? Do you have a favourite example or anecdote which seems to get the idea across much better than an precise, but dry, explanation? How is this taught in Computer Science classes?

  Read the article

• Fixed Point to Floating Point and Backwards

  - by Ahmed Khalaf

  Is converting Fixed Pt. (fixed n bit for fraction) to IEEE double safe ? ie: does IEEE double format can represent all numbers a fixed point can represent ? The test: a number goes to floating pt format then back to it's original fixed pt format.

  Read the article

• Manipulating and comparing floating points in java

  - by Praneeth

  In Java the floating point arithmetic is not represented precisely. For example following snippet of code float a = 1.2; float b= 3.0; float c = a * b; if(c == 3.6){ System.out.println("c is 3.6"); } else { System.out.println("c is not 3.6"); …

  Read the article

• Why are floating point values so prolific?

  - by Kibbee

  So, title says it all. Why are floating point values so prolific in computer programming. Due to problems like rounding errors, and not being able to even accurately represent numbers such as 0.1, I really can't see how they got as far as they did. I understand that the computation is faster with floating point numbers, however, …

  Read the article

• C++ floating point precision

  - by Davinel

  double a = 0.3; std::cout.precision(20); std::cout << a << std::endl; result: 0.2999999999999999889 double a, b; a = 0.3; b = 0; for (char i = 1; i <= 50; i++) { b = b + a; }; std::cout.precision(20); std::cout << b << std::endl; result: 15.000000000000014211 So.. 'a' is smaller than it should be.…

  Read the article

• a floating toolbar in WTL

  - by freefallr

  I've created a multimedia app that uses DirectShow to display multiple media streams simultaneously. The app is a WTL MDI application. For video windows, I use a CWindowImpl derived class - one per CChildFrame. I'd like to add controls to the video windows (volume ctrls etc). I'd initially thought about adding a slider (volume)…

  Read the article

• Comparing floating point values

  - by Sauron

  I just read a statement about the floating point value comparison Floating point values shall not be compared using either the == or != operators. Most floating point values have no exact binary representation and have a limited precision. If so what is the best method for comparing two floating point values?

  Read the article

• Is there a floating point value of x, for which x-x == 0 is false?

  - by Andrew Walker

  In most cases, I understand that a floating point comparison test should be implemented using over a range of values (abs(x-y) < epsilon), but does self subtraction imply that the result will be zero? // can the assertion be triggered? float x = //?; assert( x-x == 0 ) My guess is that nan/inf might be special cases, but…

  Read the article

• sIFR 3 no text wrap around floating images

  - by Jeremy Schultz

  Is sIFR supposed to wrap around floating images? I have some headings next to a large image float:left and the image bumps the headline down below it. Headings that aren't beside floating images do wrap properly so the functionality is there, so my question is whether or not sIFR 3 text wraps beside floating images. Jeremy

  Read the article

• How do you handle floating point rounding problems?

  - by Doc Brown

  Seeing this post about floating point errors on slashdot, I got curious what other kind of solutions exist to deal with such kind of floating point rounding errors. So what was the floating point bug you learned most from, and what did you learn from it?

  Read the article

• Does "epsilon" really guarantees anything in floating-point computations?!

  - by Michal Czardybon

  To make the problem short let's say I want to compute expression: a / (b - c) on float's. To make sure the result is meaningful, I can check if 'b' and 'c' are inequal: float eps = std::numeric_limits<float>::epsilon(); if ((b - c) > EPS || (c - b) > EPS) { return a / (b - c); } but my tests show it is not…

  Read the article

• C - floating point rounding

  - by hatorade

  I'm trying to understand how floating point numbers work. I think I'd like to test out what I know / need to learn by evaluating the following: I would like to find the smallest x such that x + 1 = x, where x is a floating point number. As I understand it, this would happen in the case where x is large enough so that x + 1…

  Read the article

• MySQL floating point comparison issues

  - by Sharief

  I ran into an issue by introducing floating point columns in the MySQL database schema that the comparisons on floating point values don't return the correct results always. 1 - 50.12 2 - 34.57 3 - 12.75 4 - ...(rest all less than 12.00) SELECT COUNT(*) FROM `users` WHERE `points` > "12.75" This returns me "3". I have…

  Read the article

• floating point hex octal binary

  - by workinprogress

  Hi, I am working on a calculator that allows you to perform calculations past the decimal point in octal, hexadecimal, binary, and of course decimal. I am having trouble though finding a way to convert floating point decimal numbers to floating point hexadecimal, octal, binary and vice versa. The plan is to do all the math…

  Read the article

• C99 and floating point environment

  - by yCalleecharan

  Hi, I was looking at new features of C99 and saw the floating point environment: #include <fenv.h> My question is simple. If I'm performing floating point number computations, do I have to include the above preprocessor directive in my code? If no, then what does this directive do and when does it become important…

  Read the article

• C# winform: Floating toolstrip like visual studio toolbar

  - by Mohsan

  hi. how can i set the toolbar to floating toolbar. this functionality is implemented in Visual studio. when we click on grip area of toolstrip and drag it it becomes floating. how to do this using ToolStrip control of Winform

  Read the article

• Ruby BigDecimal sanity check (floating point newb)

  - by Andy

  Hello, Hoping to get some feedback from someone more experienced here. I haven't dealt with the dreaded floating-point calculation before... Is my understanding correct that with Ruby BigDecimal types (even with varying precision and scale lengths) should calculate accurately or should I anticipate floating point…

  Read the article

• How does GDI+ support floating point values?

  - by Vulcan Eager

  Given that GDI+ is a wrapper around GDI, how does it handle floating point values? I don't see any support for floating point co-ordinates in the GDI documentation.

  Read the article

• floating exception using icc compiler

  - by Hristo

  I'm compiling my code via the following command: icc -ltbb test.cxx -o test Then when I run the program: time ./mp6 100 > output.modified Floating exception 4.871u 0.405s 0:05.28 99.8% 0+0k 0+0io 0pf+0w I get a "Floating exception". This following is code in C++ that I had before the exception and…

  Read the article

• What is a Bias Value of Floating Point Numbers?

  - by mudge

  In learning how floating point numbers are represented in computers I have come across the term "bias value" that I do not quite understand. The bias value in floating point numbers has to do with the negative and positiveness of the exponent part of a floating point number. The bias value of a floating…

  Read the article

• Floating point conversion from Fixed point algorithm

  - by Viks

  Hi, I have an application which is using 24 bit fixed point calculation.I am porting it to a hardware which does support floating point, so for speed optimization I need to convert all fixed point based calculation to floating point based calculation. For this code snippet, It is calculating mantissa …

  Read the article

• Floating point arithmetic is too reliable.

  - by mcoolbeth

  I understand that floating point arithmetic as performed in modern computer systems is not always consistent with real arithmetic. I am trying to contrive a small C# program to demonstrate this. eg: static void Main(string[] args) { double x = 0, y = 0; x += 20013.8; x +=…

  Read the article

1 2 3 4 5 6 7 8 9 10 11 12  | Next Page >