Newlines in BSD sed vs gsed The Next CEO of Stack OverflowInsert after a second pattern in sedHow can I instruct BSD sed to interpret escape sequences like n and t?sed on OSX insert at a certain lineadd newlines in .cshrc command outputAre there standard versions of `sed` on which `-E` is unsupported?Using sed command arguments to be compatible with both GNU & BSD Unix (in-place editing)Using BSD jot for generating file with random contentHow to add some text before another with sed in FreeBSD?Does Apple modify the GNU and BSD tools that comes with macOS?Are there multiple flavors of the GNU tools?

Is a linearly independent set whose span is dense a Schauder basis?

Is it possible to make a 9x9 table fit within the default margins?

Direct Implications Between USA and UK in Event of No-Deal Brexit

Read/write a pipe-delimited file line by line with some simple text manipulation

Is it correct to say moon starry nights?

Gauss' Posthumous Publications?

How exploitable/balanced is this homebrew spell: Spell Permanency?

Planeswalker Ability and Death Timing

Which acid/base does a strong base/acid react when added to a buffer solution?

Finitely generated matrix groups whose eigenvalues are all algebraic

Physiological effects of huge anime eyes

Free fall ellipse or parabola?

Car headlights in a world without electricity

pgfplots: How to draw a tangent graph below two others?

Why did early computer designers eschew integers?

How dangerous is XSS

Is there a rule of thumb for determining the amount one should accept for a settlement offer?

How badly should I try to prevent a user from XSSing themselves?

Is this a new Fibonacci Identity?

Is it possible to create a QR code using text?

Why was Sir Cadogan fired?

How to find if SQL server backup is encrypted with TDE without restoring the backup

How to pronounce fünf in 45

Find the majority element, which appears more than half the time



Newlines in BSD sed vs gsed



The Next CEO of Stack OverflowInsert after a second pattern in sedHow can I instruct BSD sed to interpret escape sequences like n and t?sed on OSX insert at a certain lineadd newlines in .cshrc command outputAre there standard versions of `sed` on which `-E` is unsupported?Using sed command arguments to be compatible with both GNU & BSD Unix (in-place editing)Using BSD jot for generating file with random contentHow to add some text before another with sed in FreeBSD?Does Apple modify the GNU and BSD tools that comes with macOS?Are there multiple flavors of the GNU tools?










7















The sed, which comes with FreeBSD 11.2 p7, gives:



 $ seq 10 | sed 'N; l; D; p'
1$
2$
2$
3$
3$
4$
4$
5$
5$
6$
6$
7$
7$
8$
8$
9$
9$
10$


While gsed (GNU sed 4.7) gives for the same script:



$ seq 10 | gsed 'N; l; D; p'
1n2$
2n3$
3n4$
4n5$
5n6$
6n7$
7n8$
8n9$
9n10$
10


How can we explain this difference in behavior?










share|improve this question




























    7















    The sed, which comes with FreeBSD 11.2 p7, gives:



     $ seq 10 | sed 'N; l; D; p'
    1$
    2$
    2$
    3$
    3$
    4$
    4$
    5$
    5$
    6$
    6$
    7$
    7$
    8$
    8$
    9$
    9$
    10$


    While gsed (GNU sed 4.7) gives for the same script:



    $ seq 10 | gsed 'N; l; D; p'
    1n2$
    2n3$
    3n4$
    4n5$
    5n6$
    6n7$
    7n8$
    8n9$
    9n10$
    10


    How can we explain this difference in behavior?










    share|improve this question


























      7












      7








      7








      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?










      share|improve this question
















      The sed, which comes with FreeBSD 11.2 p7, gives:



       $ seq 10 | sed 'N; l; D; p'
      1$
      2$
      2$
      3$
      3$
      4$
      4$
      5$
      5$
      6$
      6$
      7$
      7$
      8$
      8$
      9$
      9$
      10$


      While gsed (GNU sed 4.7) gives for the same script:



      $ seq 10 | gsed 'N; l; D; p'
      1n2$
      2n3$
      3n4$
      4n5$
      5n6$
      6n7$
      7n8$
      8n9$
      9n10$
      10


      How can we explain this difference in behavior?







      sed gnu newlines bsd






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited 2 days ago









      Jeff Schaller

      44.4k1162143




      44.4k1162143










      asked 2 days ago









      wolf-revo-catswolf-revo-cats

      880935




      880935




















          1 Answer
          1






          active

          oldest

          votes


















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            2 days ago












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            2 days ago











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            2 days ago












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "106"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            2 days ago












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            2 days ago











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            2 days ago
















          8














          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer




















          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            2 days ago












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            2 days ago











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            2 days ago














          8












          8








          8







          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.






          share|improve this answer















          BSD sed, when using l to output characters in a visually unambiguous form, does not output newlines in a visually unambiguous form.



          From sed(1) on OpenBSD:



           [2addr]l
          (The letter ell.) Write the pattern space to the standard output
          in a visually unambiguous form. This form is as follows:

          backslash \
          alert a
          backspace b
          form-feed f
          carriage-return r
          tab t
          vertical tab v


          (note lack of mentioning of newlines).



          GNU sed, however, includes newlines in the set of characters to display unambiguously. It does this as an extension to the set of characters that the POSIX standard for sed mentions (which is the set that BSD sed uses). GNU sed behaves this way even if --posix is used on the command line.



          GNU sed also outputs 10 twice, while BSD sed does not. Running GNU sed with POSIXLY_CORRECT set or with --posix will make it output 10 only once, like BSD sed does.



          This is because GNU sed by default ignores the part of POSIX definition of the sed N command that says




          If no next line of input is available, the N command verb shall branch to the end of the script and quit without starting a new cycle or copying the pattern space to standard output.




          Note also that the p in your sed program never executes, as D starts a new cycle.







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited 2 days ago

























          answered 2 days ago









          KusalanandaKusalananda

          139k17259430




          139k17259430







          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            2 days ago












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            2 days ago











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            2 days ago













          • 2





            Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

            – Stéphane Chazelas
            2 days ago












          • @StéphaneChazelas Thanks. I did not notice that difference at first.

            – Kusalananda
            2 days ago











          • Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

            – Stéphane Chazelas
            2 days ago








          2




          2





          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          2 days ago






          Another difference is 10 being displayed once with BSD sed, and this time GNU sed behaves like BSD sed with POSIXLY_CORRECT. That's why you generally want to use $!N instead of N when -n is not enabled.

          – Stéphane Chazelas
          2 days ago














          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          2 days ago





          @StéphaneChazelas Thanks. I did not notice that difference at first.

          – Kusalananda
          2 days ago













          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          2 days ago






          Note that ast-open's sed behaves like GNU sed wrt n displayed by l. I suspect the POSIX requirement is an oversight here (they say it's not applicable which doesn't make sense here, I suspect they say that because the pattern space normally doesn't contain newline by default but overlook the fact that it can be added by N, G, s...; if they wanted to require the original sed behaviour, they would have said something like newline shall be output literally or something like that)

          – Stéphane Chazelas
          2 days ago


















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Unix & Linux Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f509606%2fnewlines-in-bsd-sed-vs-gsed%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          រឿង រ៉ូមេអូ និង ហ្ស៊ុយលីយេ សង្ខេបរឿង តួអង្គ បញ្ជីណែនាំ

          Crop image to path created in TikZ? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Crop an inserted image?TikZ pictures does not appear in posterImage behind and beyond crop marks?Tikz picture as large as possible on A4 PageTransparency vs image compression dilemmaHow to crop background from image automatically?Image does not cropTikzexternal capturing crop marks when externalizing pgfplots?How to include image path that contains a dollar signCrop image with left size given

          Romeo and Juliet ContentsCharactersSynopsisSourcesDate and textThemes and motifsCriticism and interpretationLegacyScene by sceneSee alsoNotes and referencesSourcesExternal linksNavigation menu"Consumer Price Index (estimate) 1800–"10.2307/28710160037-3222287101610.1093/res/II.5.31910.2307/45967845967810.2307/2869925286992510.1525/jams.1982.35.3.03a00050"Dada Masilo: South African dancer who breaks the rules"10.1093/res/os-XV.57.1610.2307/28680942868094"Sweet Sorrow: Mann-Korman's Romeo and Juliet Closes Sept. 5 at MN's Ordway"the original10.2307/45957745957710.1017/CCOL0521570476.009"Ram Leela box office collections hit massive Rs 100 crore, pulverises prediction"Archived"Broadway Revival of Romeo and Juliet, Starring Orlando Bloom and Condola Rashad, Will Close Dec. 8"Archived10.1075/jhp.7.1.04hon"Wherefore art thou, Romeo? To make us laugh at Navy Pier"the original10.1093/gmo/9781561592630.article.O006772"Ram-leela Review Roundup: Critics Hail Film as Best Adaptation of Romeo and Juliet"Archived10.2307/31946310047-77293194631"Romeo and Juliet get Twitter treatment""Juliet's Nurse by Lois Leveen""Romeo and Juliet: Orlando Bloom's Broadway Debut Released in Theaters for Valentine's Day"Archived"Romeo and Juliet Has No Balcony"10.1093/gmo/9781561592630.article.O00778110.2307/2867423286742310.1076/enst.82.2.115.959510.1080/00138380601042675"A plague o' both your houses: error in GCSE exam paper forces apology""Juliet of the Five O'Clock Shadow, and Other Wonders"10.2307/33912430027-4321339124310.2307/28487440038-7134284874410.2307/29123140149-661129123144728341M"Weekender Guide: Shakespeare on The Drive""balcony"UK public library membership"romeo"UK public library membership10.1017/CCOL9780521844291"Post-Zionist Critique on Israel and the Palestinians Part III: Popular Culture"10.2307/25379071533-86140377-919X2537907"Capulets and Montagues: UK exam board admit mixing names up in Romeo and Juliet paper"Istoria Novellamente Ritrovata di Due Nobili Amanti2027/mdp.390150822329610820-750X"GCSE exam error: Board accidentally rewrites Shakespeare"10.2307/29176390149-66112917639"Exam board apologises after error in English GCSE paper which confused characters in Shakespeare's Romeo and Juliet""From Mariotto and Ganozza to Romeo and Guilietta: Metamorphoses of a Renaissance Tale"10.2307/37323537323510.2307/2867455286745510.2307/28678912867891"10 Questions for Taylor Swift"10.2307/28680922868092"Haymarket Theatre""The Zeffirelli Way: Revealing Talk by Florentine Director""Michael Smuin: 1938-2007 / Prolific dance director had showy career"The Life and Art of Edwin BoothRomeo and JulietRomeo and JulietRomeo and JulietRomeo and JulietEasy Read Romeo and JulietRomeo and Julieteeecb12003684p(data)4099369-3n8211610759dbe00d-a9e2-41a3-b2c1-977dd692899302814385X313670221313670221