XML module

[impixiParticipant]

Is anyone coding an XML module for MX2?

If not, any suggestions for a C/C++ XML library to wrap? Or maybe a “native” BlitzMax or Monkey1 solution to port?

I just need something simple: load and parse basic but “well-formed” XML and create a DOM-like tree structure from it.

[Mark SiblyKeymaster]

tinyxml2 looks very tidy…

http://www.grinninglizard.com/tinyxml2/

The mx2 API would probably look something like:

Monkey

Class XMLNode Method GetDocument:XMLDocument() Method NoChildren:Bool() Method Parent:XMLNode() Method FirstChild:XMLNode() Method NextSibling:XMLNode() Method Value:String() End Class XMLDocument Extends XMLNode End Class XMLComment Extends XMLNode End Class XMLElement Extends XMLNode End Class XMLDeclaration Extends XMLNode End Class XMLText Extends XMLNode End Class XMLUnknown Extends XMLNode End Function LoadXMLDocument:XMLDocument( path:String ) End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37

Class XMLNode   Method GetDocument:XMLDocument() Method NoChildren:Bool() Method Parent:XMLNode() Method FirstChild:XMLNode() Method NextSibling:XMLNode() Method Value:String() End   Class XMLDocument Extends XMLNode End   Class XMLComment Extends XMLNode End   Class XMLElement Extends XMLNode End   Class XMLDeclaration Extends XMLNode End   Class XMLText Extends XMLNode End   Class XMLUnknown Extends XMLNode End   Function LoadXMLDocument:XMLDocument( path:String ) End

There’s more methods, but that’s the jist of it, just yer basic tree. Is that the sort of thing you’re after?

[ArjailerParticipant]

I converted skn3’s Monkey X xml module to Monkey 2. It’s pure Monkey 2 code with no dependencies. I don’t have it on this PC, but I could post it later if you’re interested.

TinyXML looks good though  

[Mark SiblyKeymaster]

I’ve made a pretty good start on tinyxml2, but the more the merrier! Wish people would staring using that module manager thingy though…

Anyway, I’m more of a JSON guy myself, but is this pretty much what you need from an xml module?

Monkey

Function Dump( node:XMLNode,indent:String ) Print indent+node.Value() Local child:=node.FirstChild() While child Dump( child,indent+" " ) child=child.NextSibling() Wend End Function Main() Local xml:=LoadString( "asset::dream.xml" ) Local doc:=New XMLDocument If doc.Parse( xml )<>XMLError.XML_SUCCESS Print "Failed to parse" Return Endif Print "Parsed!" Dump( doc,"" ) doc.Destroy() Print "Bye!" End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36

Function Dump( node:XMLNode,indent:String )   Print indent+node.Value() Local child:=node.FirstChild() While child Dump( child,indent+"  " ) child=child.NextSibling() Wend   End   Function Main()   Local xml:=LoadString( "asset::dream.xml" ) Local doc:=New XMLDocument If doc.Parse( xml )<>XMLError.XML_SUCCESS Print "Failed to parse" Return Endif Print "Parsed!" Dump( doc,"" ) doc.Destroy() Print "Bye!" End

…which produces…

Monkey

xml version="1.0" DOCTYPE PLAY SYSTEM "play.dtd" PLAY TITLE A Midsummer Night's Dream FM P Text placed in the public domain by Moby Lexical Tools, 1992. P SGML markup by Jon Bosak, 1992-1994. P XML version by Jon Bosak, 1996-1998. P This work may be freely copied and distributed worldwide. PERSONAE TITLE Dramatis Personae PERSONA THESEUS, Duke of Athens. PERSONA EGEUS, father to Hermia. PGROUP PERSONA ...etc...

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25

xml version="1.0"   DOCTYPE PLAY SYSTEM "play.dtd"   PLAY     TITLE       A Midsummer Night's Dream     FM       P         Text placed in the public domain by Moby Lexical Tools, 1992.       P         SGML markup by Jon Bosak, 1992-1994.       P         XML version by Jon Bosak, 1996-1998.       P         This work may be freely copied and distributed worldwide.     PERSONAE       TITLE         Dramatis Personae       PERSONA         THESEUS, Duke of Athens.       PERSONA         EGEUS, father to Hermia.       PGROUP         PERSONA   ...etc...

[impixiParticipant]

@Mark

Anyway, I’m more of a JSON guy myself, but is this pretty much what you need from an xml module?

That’s exactly what I’m looking for.

Regarding JSON, XML, etc. I’m usually an INI or CSV or pure binary data guy, but I’m working on a project where I can actually see the benefit of using XML-formatted data. JSON has never really “gelled” with me, I tend to avoid it.

Wish people would staring using that module manager thingy though…

Indeed, that would be nice. :). I have a few half-finished modules I hope to finish soon. I’ll upload them when I do.

@arjailer

That Monkey1 module by skn3 is the one I had planned to port if nobody else had started on an XML module…

[ArjailerParticipant]

Here’s the xml parser.

I might upload it as a module later, but between adding a demo app and adding documentation it’s actually a fair amount of work.

Edit: Especially as it’s not originally my code so documenting it might be “fun”  

Attachments:

1. skn3xml.zip

[ArjailerParticipant]

I do have Linq-like extension methods for List<T> and Stack<T> that I would like to upload to the module manager. Might work on that a bit today.

[ArjailerParticipant]

Hmmm … do extension methods not work in modules?

The module builds but I’m getting pretty much empty .cpp source files in my windows_debug folder and if I try to use any of the extension methods I get “undefined reference” errors.

It all works fine when built as an app where the .cpp source files contain everything I’d expect to see.

If I build the app without actually referencing or using any of the extension methods I get the same empty .cpp source files as I’m seeing in the module. This makes sense for building an app ‘cos it’s only building what it needs to, but I wouldn’t have thought a module would do that?

Am I missing something about building modules?

[impixiParticipant]

@Mark

Woohoo! Just tried the latest GIT release and have been playing around with the tinyxml module. Works nicely so far. Thanks!

Here’s an example that builds a mojox tree from that “dream.xml” file included with the banana:

Monkey

[crayon-5cb9d7b288a31419683603 inline="true" ] #Import "<std>" #Import "<mojo>" #import "<mojox>" #Import "<tinyxml2>" #Import "dream.xml" Using std.. Using mojo.. Using mojox.. Using tinyxml2.. Function Main() New AppInstance New MyWindow("asset::dream.xml") App.Run() End Class MyWindow Extends Window Field _tree:TreeView Method New(url:String) Super.New("XML TreeView Test", 640, 480, WindowFlags.Resizable) Local xml := LoadString(url) Local doc := New XMLDocument() If doc.Parse(xml) <> XMLError.XML_SUCCESS Print "Failed to parse: " + url Return Endif Local _tree := New TreeView _tree.RootNode.Text = "XML document" AddXMLNodeToTree(doc, _tree.RootNode) ContentView = _tree doc.Destroy() End Method AddXMLNodeToTree(xmlNode:XMLNode, parent:TreeView.Node) Local str := "" If xmlNode.ToElement() str += "<" + xmlNode.Value() + ">" Else str += xmlNode.Value() Endif Local treeNode:TreeView.Node If str treeNode = New TreeView.Node(str, parent) Endif Local xmlChild := xmlNode.FirstChild() While xmlChild If Not xmlChild.NoChildren() If treeNode Then parent = treeNode Endif AddXMLNodeToTree(xmlChild, parent) xmlChild = xmlChild.NextSibling() Wend End End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84

[crayon-5cb9d7b288a31419683603 inline="true" ] #Import "<std>" #Import "<mojo>" #import "<mojox>" #Import "<tinyxml2>"   #Import "dream.xml"   Using std.. Using mojo.. Using mojox.. Using tinyxml2..   Function Main()   New AppInstance New MyWindow("asset::dream.xml") App.Run() End   Class MyWindow Extends Window   Field _tree:TreeView   Method New(url:String) Super.New("XML TreeView Test", 640, 480, WindowFlags.Resizable)   Local xml := LoadString(url) Local doc := New XMLDocument() If doc.Parse(xml) <> XMLError.XML_SUCCESS Print "Failed to parse: " + url Return Endif Local _tree := New TreeView   _tree.RootNode.Text = "XML document"   AddXMLNodeToTree(doc, _tree.RootNode) ContentView = _tree doc.Destroy() End   Method AddXMLNodeToTree(xmlNode:XMLNode, parent:TreeView.Node) Local str := "" If xmlNode.ToElement() str += "<" + xmlNode.Value() + ">" Else str += xmlNode.Value() Endif   Local treeNode:TreeView.Node If str treeNode = New TreeView.Node(str, parent) Endif Local xmlChild := xmlNode.FirstChild() While xmlChild If Not xmlChild.NoChildren() If treeNode Then parent = treeNode Endif AddXMLNodeToTree(xmlChild, parent) xmlChild = xmlChild.NextSibling() Wend End   End

[/crayon]

@arjailer

Thanks for posting your code. I’ll experiment with that later, see how it compares to Mark’s tinyxml wrapper solution.

[impixiParticipant]

Another tinyxml2 example with element attributes and “embedded XML”:

Monkey

[crayon-5cb9d7b28d90b354693032 inline="true" ] #Import "<std>" #Import "<mojo>" #import "<mojox>" #Import "<tinyxml2>" Using std.. Using mojo.. Using mojox.. Using tinyxml2.. Function Main() New AppInstance New MyWindow() App.Run() End Class MyWindow Extends Window Field _tree:TreeView Method New() Super.New("XML TreeView Test", 640, 480, WindowFlags.Resizable) Local xml := LoadEmbeddedXMLString() Local doc := New XMLDocument() If doc.Parse(xml) <> XMLError.XML_SUCCESS Print "Failed to parse embedded XML!" Return Endif Local _tree := New TreeView _tree.RootNode.Text = "XML document" AddXMLNodeToTree(doc, _tree.RootNode) ContentView = _tree doc.Destroy() End Method AddXMLNodeToTree(xmlNode:XMLNode, parent:TreeView.Node) Local str := "" Local xmlElement := xmlNode.ToElement() If xmlElement str += "<" + xmlNode.Value() Local attrib := xmlElement.FirstAttribute() While attrib str += " " + attrib.Name() + "=~q" + attrib.Value() + "~q " attrib=attrib.NextAttribute() wend str += ">" Else str += xmlNode.Value() Endif Local treeNode:TreeView.Node If str treeNode = New TreeView.Node(str, parent) Endif Local xmlChild := xmlNode.FirstChild() While xmlChild If Not xmlChild.NoChildren() If treeNode Then parent = treeNode Endif AddXMLNodeToTree(xmlChild, parent) xmlChild = xmlChild.NextSibling() Wend End End Function LoadEmbeddedXMLString:string() Local str := " <?xml version=~q1.0~q encoding=~qUTF-8~q?> <recipes> <recipe> <name>Recall Scroll</name> <results> <item name=~qRecall Scroll~q quantity=~q1~q /> </results> <requirements> <skill name=~qAlchemy~q level=~q0~q /> <item name=~qMortar and Pestle~q quantity=~q1~q /> <item name=~qWood Pulp~q quantity=~q5~q /> <item name=~qNightshade~q quantity=~q10~q /> <item name=~qBlack Pearl~q quantity=~q10~q /> </requirements> </recipe> <recipe> <name>Teleport Scroll</name> <results> <item name=~qTeleport Scroll~q quantity=~q1~q /> </results> <requirements> <skill name=~qAlchemy~q level=~q0~q /> <item name=~qMortar and Pestle~q quantity=~q1~q /> <item name=~qWood Pulp~q quantity=~q5~q /> <item name=~qMandrake Root~q quantity=~q10~q /> <item name=~qBlack Pearl~q quantity=~q10~q /> </requirements> </recipe> </recipes> " Return str End

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134

[crayon-5cb9d7b28d90b354693032 inline="true" ] #Import "<std>" #Import "<mojo>" #import "<mojox>" #Import "<tinyxml2>"   Using std.. Using mojo.. Using mojox.. Using tinyxml2..   Function Main()   New AppInstance New MyWindow() App.Run() End   Class MyWindow Extends Window   Field _tree:TreeView   Method New() Super.New("XML TreeView Test", 640, 480, WindowFlags.Resizable)   Local xml := LoadEmbeddedXMLString() Local doc := New XMLDocument() If doc.Parse(xml) <> XMLError.XML_SUCCESS Print "Failed to parse embedded XML!" Return Endif Local _tree := New TreeView   _tree.RootNode.Text = "XML document"   AddXMLNodeToTree(doc, _tree.RootNode) ContentView = _tree doc.Destroy() End   Method AddXMLNodeToTree(xmlNode:XMLNode, parent:TreeView.Node) Local str := "" Local xmlElement := xmlNode.ToElement() If xmlElement str += "<" + xmlNode.Value() Local attrib := xmlElement.FirstAttribute() While attrib str += " " + attrib.Name() + "=~q" + attrib.Value() + "~q " attrib=attrib.NextAttribute() wend str += ">" Else str += xmlNode.Value() Endif   Local treeNode:TreeView.Node If str treeNode = New TreeView.Node(str, parent) Endif Local xmlChild := xmlNode.FirstChild() While xmlChild If Not xmlChild.NoChildren() If treeNode Then parent = treeNode Endif AddXMLNodeToTree(xmlChild, parent) xmlChild = xmlChild.NextSibling() Wend End   End   Function LoadEmbeddedXMLString:string() Local str := " <?xml version=~q1.0~q encoding=~qUTF-8~q?> <recipes>   <recipe>     <name>Recall Scroll</name>     <results>         <item name=~qRecall Scroll~q quantity=~q1~q />     </results>     <requirements>       <skill name=~qAlchemy~q level=~q0~q />       <item name=~qMortar and Pestle~q quantity=~q1~q />       <item name=~qWood Pulp~q quantity=~q5~q />       <item name=~qNightshade~q quantity=~q10~q />       <item name=~qBlack Pearl~q quantity=~q10~q />     </requirements>   </recipe>   <recipe>     <name>Teleport Scroll</name>     <results>         <item name=~qTeleport Scroll~q quantity=~q1~q />     </results>     <requirements>       <skill name=~qAlchemy~q level=~q0~q />       <item name=~qMortar and Pestle~q quantity=~q1~q />       <item name=~qWood Pulp~q quantity=~q5~q />       <item name=~qMandrake Root~q quantity=~q10~q />       <item name=~qBlack Pearl~q quantity=~q10~q />     </requirements>   </recipe> </recipes> "   Return str   End

[/crayon]

[Mark SiblyKeymaster]

The module builds but I’m getting pretty much empty .cpp source files in my windows_debug folder and if I try to use any of the extension methods I get “undefined reference” errors.

Are you using the latest mx2cc? Extensions are undergoing ongoing maintenance…

If you are, can you reproduce with a simple example?

[ArjailerParticipant]

Actually, it looks like I’m not on the latest version. I’ll update later and give it a try.

[ArjailerParticipant]

Extension methods fail to build at all with the latest code, whether as a module or not.

Lots of “Blah:T?(T?) must be a generic class type” errors.

The code built fine in v1.0.5

Have attached if you want to have a look.

Attachments:

1. linq.zip

[ArjailerParticipant]

Also, the following no longer works in the latest build either:

Monkey

Namespace test #Import "<std>" Using std.. Function Main() Print(Int(TestGenericMethod<Int>())) End Function TestGenericMethod<T>:Bool() Where T Implements INumeric Return True End

1 2 3 4 5 6 7 8 9 10 11 12 13 14

Namespace test   #Import "<std>"   Using std..   Function Main() Print(Int(TestGenericMethod<Int>())) End   Function TestGenericMethod<T>:Bool() Where T Implements INumeric Return True End

Get error: Can’t find overload for ‘TestGenericMethod<int>(…)’ with argument types ()

Again, this used to work in v1.0.5, and works in 1.0.6 if I remove the Where clause

[Mark SiblyKeymaster]

Have you got a small test program for the Linq stuff?

[Author]

Posts