Replacing LF, NEL line endings in text file with CR+LF

Posted by Tomas Lycken on Ask Ubuntu See other posts from Ask Ubuntu or by Tomas Lycken
Published on 2012-08-29T09:05:45Z Indexed on 2012/08/29 9:50 UTC
Read the original article Hit count: 297

Filed under:

encoding

|

line-endings

I have a text file with a strange character encoding that I'd like to convert to standard UTF-8. I have managed to get part of the way:

$ file myfile.txt
myfile.txt:        Non-ISO extended-ASCII text, with LF, NEL line endings
$ iconv -f ascii -t utf-8 myfile.txt > myfile.txt.utf8
$ file myfile.txt.utf8
myfile.txt.utf8:   UTF-8 Unicode text, with LF, NEL line endings

## edit myfile.txt.utf8 using nano, to fix failed character conversions (mostly åäö)

$ file myfile.txt.utf8
myfile.txt.utf8:   UTF-8 Unicode text, with LF, NEL line endings

However, I can't figure out how to convert the line endings. How do I do to replace LF+NEL with CR+LF (or whatever is the standard)? When I'm done, I'd like to see the following:

$ file myfile.txt
myfile.txt:        UTF-8 Unicode text

© Ask Ubuntu or respective owner

Related posts about encoding

<?xml version=“1.0” encoding=“UTF-8”?> not <?xml version='1.0' encoding='UTF-8'?>

as seen on Stack Overflow - Search for 'Stack Overflow'
I am using lxml with tree.write(xmlFileOut, pretty_print = True, xml_declaration = True, encoding='UTF-8' to write out my opened and edited xml file, but I absolutely need to have the xml declaration as <?xml version=“1.0” encoding=“UTF-8”?> and NOT <?xml version='1.0' encoding='UTF-8'… >>> More
Ivar definitions show 'long' type encoding as 'long long' type encoding

as seen on Stack Overflow - Search for 'Stack Overflow'
I've found what I think may be a bug with Ivar and Objective-C runtime. I'm using XCode 3.2.1 and associated libraries, developing a 64 bit app on X86_64 (MacBook Pro). Where I would expect the type encoding for the following "longVal" to be 'l', the Ivar encoding is showing a 'q' (which is a 'long… >>> More
How to avoid encoding the key of request parameters being encoding

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to send a http request using WS.url() with a action receive a custom class parameter like public static void add(@Valid MyPage info) {...} There is a Map in MyPage @Required public Map<String, String> content = new HashMap<String, String>(); But When I try to send a request… >>> More
C# Check if character exists in encoding

as seen on Stack Overflow - Search for 'Stack Overflow'
I am writing a program that a part renders a bitmap font in CP437. In a function that renders the text with I want to be able to check whether a char is available in CP437 before the encoding conversion, like: public static void DrawCharacter(this Graphics g, char c) { if (char_exist_in_encoding(Encoding… >>> More
How to detect the character encoding of a text file?

as seen on Stack Overflow - Search for 'Stack Overflow'
I try to detect which character encoding is used in my file. I try with this code to get the standard encoding public static Encoding GetFileEncoding(string srcFile) { // *** Use Default of Encoding.Default (Ansi CodePage) Encoding enc = Encoding.Default; // *** Detect byte… >>> More

Related posts about line-endings

Replacing LF, NEL line endings in text file with CR+LF

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I have a text file with a strange character encoding that I'd like to convert to standard UTF-8. I have managed to get part of the way: $ file myfile.txt myfile.txt: Non-ISO extended-ASCII text, with LF, NEL line endings $ iconv -f ascii -t utf-8 myfile.txt > myfile.txt.utf8 $ file myfile… >>> More
Vi on Linux: show ^M line endings for DOS-format files

as seen on Super User - Search for 'Super User'
On Solaris, if you open a file in vi that has Windows line endings, this shows up as ^M at the end of every line. On Linux, vi is cleverer and understands the Windows file format, and does not display ^M. Is there a setting to make Linux vi behave the same as Solaris in this respect? A common problem… >>> More
editing a file with vim that has no EOL marker on the last line but has CRLF line endings

as seen on Stack Overflow - Search for 'Stack Overflow'
I often have to edit script files, the interpreter for which treats files that have an EOL marker on the last line of the file as an error (i.e. the file is treating CRLF as "newlines", not as "line endings"). Currently, I open these files in Vim using binary mode (-b on the command line). It autodetects… >>> More
How to write text files with DOS line endings on linux

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to write text files with DOS/Windows line endings '\r\n' using python running on Linux. It seems to me that there must be a better way than manually putting a '\r\n' at the end of every line or using a line ending conversion utility. Ideally I would like to be able to do something like assign… >>> More
Using python to write text files with DOS line endings on linux

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to write text files with DOS/Windows line endings '\r\n' using python running on Linux. It seems to me that there must be a better way than manually putting a '\r\n' at the end of every line or using a line ending conversion utility. Ideally I would like to be able to do something like assign… >>> More