Search Results

Search found 680 results on 28 pages for 'precision'.

Page 9/28 | < Previous Page | 5 6 7 8 9 10 11 12 13 14 15 16  | Next Page >

• Phone complains that identical GLSL struct definition differs in vert/frag programs

  - by stephelton

  When I provide the following struct definition in linked frag and vert shaders, my phone (Samsung Vibrant / Android 2.2) complains that the definition differs. struct Light { mediump vec3 _position; lowp vec4 _ambient; lowp vec4 _diffuse; lowp vec4 _specular; bool _isDirectional; mediump vec3 _attenuation; // constant,…

  Read the article

• Is it relevant to warn about truncating real constants to 32 bits?

  - by zneak

  I'm toying around with LLVM and looking at what it would take to make yet another strongly-typed language, and now that I'm around the syntax, I've noticed that it seems to be a pet peeve of strongly typed language to warn people that their constants won't fit inside a float: // both in Java and C# float foo = 3.2; // error: implicitly…

  Read the article

• How to move a sata drive to a machine without AHCI mode

  - by Andrew Cooper

  I've got a Dell Inspiron 1545 on which the screen has died. I'm able to plug an external monitor into the Inspiron 1545 and it works fine, so the screen is the only issue. The OS is Win7. I'm trying to move the disk to a spare Dell Precision M90 laptop that I've got lying around. The problem is that almost as soon as the Windows…

  Read the article

• How to truncate milliseconds off of a .NET DateTime

  - by Jeff Putz

  I'm trying to compare a time stamp from an incoming request to a database stored value. SQL Server of course keeps some precision of milliseconds on the time, and when read into a .NET DateTime, it includes those milliseconds. The incoming request to the system, however, does not offer that precision, so I need to simply drop the…

  Read the article

• Fastest sorting algorithm for a specific situation

  - by luvieere

  What is the fastest sorting algorithm for a large number (tens of thousands) of groups of 9 positive double precision values, where each group must be sorted individually? So it's got to sort fast a small number of possibly repeated double precision values, many times in a row. The values are in the [0..1] interval. I don't care…

  Read the article

• ActiveScaffold keeps rounding my numbers

  - by jaycode

  I need to display & edit highly precise decimal numbers - latitude and longitude. ActiveScaffold keep rounding my values to precision 6 scale 3, can I change that to precision 11 scale 8 somewhere? Thanks

  Read the article

• OleDB Jet - Float issues in reading excel data

  - by Patrick

  When I read a sheet into a DataTable using the OleDbDataReader, floating point numbers loose their precision. I tried forcing OleDb to read the excel data as string, but although the data is now contained in a DataRow with each Column defined as System.String it looses precision (18.125 - 18.124962832). Any idea how to avoid…

  Read the article

• Oracle: Is there a way to get the column data types for a view?

  - by rally25rs

  For a table in oracle, I can query "all_tab_columns" and get table column information, like the data type, precision, whether or not the column is nullable. In SQL Developer or TOAD, you can click on a view in the GUI and it will spit out a list of the columns that the view returns and the same set of data (data type,…

  Read the article

• A story of Murphy&ndash;my technical issues at TechDays Switzerland #chtd

  - by Laurent Bugnion

  I had two sessions at the recent Swiss TechDays. While the first one (Advanced Development for Windows Phone 8) went extremely well (I think), I had a very annoying technical issue in the beginning of my second session. First let me add that I talked to Microsoft about that and I hope they will change a few things in…

  Read the article

• Float addition promoted to double?

  - by Andreas Brinck

  I had a small WTF moment this morning. Ths WTF can be summarized with this: float x = 0.2f; float y = 0.1f; float z = x + y; assert(z == x + y); //This assert is triggered! (Atleast with visual studio 2008) The reason seems to be that the expression x + y is promoted to double and compared with the truncated…

  Read the article

• Box 2d basic questions

  - by philipp

  I am a bit new to box2d and I am developing an game with type and letters. I am using an svg font and generate the box2d bodies direct from the glyphs path definition, using the convex hull of them. I also have an decomposition routine the decomposes this hull if necessary. All this it is more or less working,…

  Read the article

• Extreme Optimization –Mathematical Constants and Basic Functions

  - by JoshReuben

  Machine constants The MachineConstants class - contains constants for floating-point arithmetic because the CLS System.Single and Double floating-point types do not follow the standard conventions and are useless. machine constants for the Double type: machine precision: Epsilon , SqrtEpsilon …

  Read the article

• System speakers not recognized

  - by Kyle Maxwell

  Since upgrading to Xubuntu 13.10, sound has not functioned properly (e.g. screeching when playing Skype notifications). Now, however, it does not function at all. pavucontrol only shows Dummy Output and does not recognize the built-in speakers on my Dell Precision M4600. Possibly related, the sound…

  Read the article

• Confusion with floats converted into ints during collision detection

  - by TheBroodian

  So in designing a 2D platformer, I decided that I should be using a Vector2 to track the world location of my world objects to retain some sub-pixel precision for slow-moving objects and other such subtle nuances, yet representing their bodies with Rectangles, because as far as collision detection…

  Read the article

• How to make sure you server NIC performance is at best on Windows?

  - by Bobb

  I realised that I followed some obscure paper on setting NICs on Windows for too long. It might be outdated with new hardware released in past couple of years and with W2008R2. I read a bit about offloading and RSS settings on Windows and I realiased that it is very much circumstantial. Noone can…

  Read the article

• Moving a copied layer group precisely in GIMP to make a paper of business cards?

  - by rautamiekka

  I found a template with space for 10 business cards, without extra space anywhere. Using GIMP 2.8.10, I made the design in top left slot and now I need to get that to the other slots. What is the best way to achieve that ? Using mouse is out of question for lack of precision and keyboard takes too…

  Read the article

• C++ reading and writing and writing files

  - by user320950

  Write a program that processes a list of items purchased with a receipt List in itemlist.txt just items different numbers Prices in pricelist.txt have items and prices in them, different # Make file output file that has receipt Print message saying program ran- have not done If item not in…

  Read the article

• Programs won't write to a file, and I do not know if it is reading it

  - by user320950

  This program is supposed to read files and write them. I took the file open checks out because they kept causing errors. The problem is that the files open like they are supposed to and the names are correct but nothing is on any of the text screens. Do you know what is wrong? …

  Read the article

• Parse ISO8601 date in Objective-C (iPhone OS SDK)

  - by bradley.ayers

  How do I parse "2010-04-30T00:45:48.711127" into an NSDate? (and maintain all precision)

  Read the article

• Python: wxpython wx.media.MediaCtrl - millisecond seek capability

  - by PPTim

  I've been searching for a media player that can display sub-second resolution in videos. Some pointed me to the Frame stepping functionality in MPC, but I'd like even more than that. I know from previous experience with wxPython that the wx.media.MediaCtrl both displays and…

  Read the article

• How to define a varying length of the string in XSD pattern?

  - by infant programmer

  The input XML tag must be validated for a pattern which is like this: type : positive int / decimal, minimum length is 0, max length is 12(before decimal point), fraction digits are optional if exist then precision must be 2. This means both positive integer and Decimal…

  Read the article

• Why isn't this file reading/writing program working?

  - by user320950

  This program is supposed to read files and write them. I took the file open checks out because they kept causing errors. The problem is that the files open like they are supposed to and the names are correct but nothing is on any of the text screens. Do you know what is…

  Read the article

• What is the cost in bytes for the overhead of a sql_variant column in SQL Server?

  - by Elan

  I have a table, which contains many columns of float data type with 15 digit precision. Each column consumes 8 bytes of storage. Most of the time the data does not require this amount of precision and could be stored as a real data type. In many cases the value can be…

  Read the article

• how to get a real time clock in C#?

  - by moon

  i want a real time clock with precision of microseconds how can i do so?

  Read the article

• C++ integer floor function

  - by Thomas

  I want to implement greatest integer function. int x = 5/3; My question is with greater numbers could there be a loss of precision as 5/3 would produce a double? EDIT: Greatest integer function is integer less than or equal to X. Example: 4.5 = 4 4 = 4 3.2 = 3 3…

  Read the article

< Previous Page | 5 6 7 8 9 10 11 12 13 14 15 16  | Next Page >