XML with multiple tags

user_16026644 0
Viewed 173

Problem is parsing through an xml that starts right after <Envelope>

from bs4 import BeautifulSoup
Filename =input("Enter File name to be imported :" )
imp_ext = ".xml"
imp_file = ("".join([Filename,imp_ext]))
#it is in UTF-16BE format
with open(imp_file, encoding= 'UTF-16') as fp:  
    soup = BeautifulSoup(fp, 'xml')

Soup has this data:

<?xml version="1.0" encoding="UTF-8"?>
<ENVELOPE>
   <DSPACCNAME>
      <DSPDISPNAME>206375</DSPDISPNAME>
   </DSPACCNAME>
   <DSPSTKINFO>
      <DSPSTKOUT>
         <DSPOUTQTY>1 EA</DSPOUTQTY>
         <DSPOUTRATE>715.00</DSPOUTRATE>
         <DSPNETTCRAMTA>715.00</DSPNETTCRAMTA>
         <DSPCRAMTA>715.00</DSPCRAMTA>
         <DSPCONSAMT>-358.62</DSPCONSAMT>
         <DSPGPAMT>356.38</DSPGPAMT>
         <DSPGPPERC>49.84 %</DSPGPPERC>
      </DSPSTKOUT>
      <DSPSTKCL>
         <DSPCLQTY>3 EA</DSPCLQTY>
         <DSPCLRATE>358.62</DSPCLRATE>
         <DSPCLAMTA>-1075.87</DSPCLAMTA>
      </DSPSTKCL>
   </DSPSTKINFO>
   <SSBATCHNAME>
      <SSBATCH />
      <SSGODOWN>Ware -House (Mankoli-Bhiwandi)</SSGODOWN>
   </SSBATCHNAME>
   <DSPSTKINFO>
      <DSPSTKOUT>
         <DSPOUTQTY>1 EA</DSPOUTQTY>
         <DSPOUTRATE>715.00</DSPOUTRATE>
         <DSPNETTCRAMTA>715.00</DSPNETTCRAMTA>
         <DSPCRAMTA>715.00</DSPCRAMTA>
         <DSPCONSAMT>-358.62</DSPCONSAMT>
         <DSPGPAMT>356.38</DSPGPAMT>
         <DSPGPPERC>49.84 %</DSPGPPERC>
      </DSPSTKOUT>
      <DSPSTKCL>
         <DSPCLQTY>3 EA</DSPCLQTY>
         <DSPCLRATE>358.62</DSPCLRATE>
         <DSPCLAMTA>-1075.87</DSPCLAMTA>
      </DSPSTKCL>
   </DSPSTKINFO>
</ENVELOPE>

then I am trying to extract data from xml file I also tried:

for a in soup.findAll('DSPACCNAME'):
    for b in soup.findAll('DSPSTKINFO'):
        print(a.DSPDISPNAME)
        print(b.DSPCLQTY)
        print(b.DSPCLRATE)
        print(b.DSPCLAMTA)

I am getting output that is something like this:

206375

1 EA

715.00

715.00

715.00

-358.62

356.38

49.84 %

Issue is I don't have a parent class that creates a boundary. I am trying to extract the data in CSV format. Data comes from tally. It is called stock summary to be exact. I have no idea how to proceed. Data comes with empty values as well. And that needs to be captured as it is.

edit* : I am purposefully putting a part of xml that has all the data needed to be extracted (row 13 of image is the expected output). Output needs to be something that has all these values, with lowest level granularity(Every thing in 1 row) please have a look at this image for reference:

enter image description here

beautifulsoup csv xml python
1 Answers

I summarize my proposal for a solution with the SAX-parser, which is very performant, but its structure takes a bit of effort for the tuning of the needed results.

#https://stackoverflow.com/questions/70437073/xml-with-multiple-tags
from collections import OrderedDict
from xml.sax.handler import ContentHandler
import xml.sax
import sys

class CustomHandler(ContentHandler):
    def __init__( self ):
        tmp = ["DSPACCNAME", "DSPSTKOUT", "DSPSTKCL"] # extensible with further tags
        self.tags = OrderedDict()
        for t in tmp:
            self.tags.setdefault(t, False)

    def startElement(self, name, attrs):
        if name in self.tags.keys():
            self.tags[name] = True
            sys.stdout.write("\n%s\n%15s\n" % (name.strip(), "="*15))

    def characters(self, content):
        for v  in self.tags.values():
            if v:
                sys.stdout.write("%3s" % content.strip())

    def endElement(self, name):
        if name in self.tags.keys():
            self.tags[name] = False 

parser = xml.sax.make_parser()
handler = CustomHandler()
parser.setContentHandler(handler)
parser.parse("test.xml")

RESULTS: 

DSPACCNAME
===============
      206375      
DSPSTKOUT
===============
      1 EA      715.00      715.00      715.00      -358.62      356.38      49.84 %      
DSPSTKCL
===============
      3 EA      358.62      -1075.87      
DSPSTKOUT
===============
      1 EA      715.00      715.00      715.00      -358.62      356.38      49.84 %      
DSPSTKCL
===============
      3 EA      358.62      -1075.87
user_177188700
Related