bash - Extract multiple values between XML tags -


i have xml file tripadvisor page, , shows restaurants in specific area.

i want extract 'cuisines' offered of restaurants in search result. of values stored between <a> , <span> html tags.

for each restaurant, data stored between <div> tag, snippet of cuisines 1 restaurant shown below:

<div class="cuisines"> <span class="item price">££ - £££</span> <span class="item cuisine" onclick="ta.restaurant_list_tracking.clicknonlinkedcuisine()">bar</span> <a class="item cuisine" href="/restaurants-g1096751-c7-whittlebury_northamptonshire_england.html" onclick="ta.setevtcookie('restaurant_details', 'restaurants_details_cuisine', '', 0, this.href);">british</a> <span class="item cuisine" onclick="ta.restaurant_list_tracking.clicknonlinkedcuisine()">pub</span> <span class="item cuisine" onclick="ta.restaurant_list_tracking.clicknonlinkedcuisine()">gastropub</span> <a class="item cuisine" href="/restaurants-g1096751-zfz10665-whittlebury_northamptonshire_england.html" onclick="ta.setevtcookie('restaurant_details', 'restaurants_details_cuisine', '', 0, this.href);">vegetarian friendly</a> <a class="item cuisine" href="/restaurants-g1096751-zfz10992-whittlebury_northamptonshire_england.html" onclick="ta.setevtcookie('restaurant_details', 'restaurants_details_cuisine', '', 0, this.href);">gluten free options</a> </div>

how go extracting cuisines between these div tags each restaurant , outputting new text file?

the expected output want snippet of code be:

bar, british, pub, gastropub, vegetarian friendly, gluten free options

mind you, there several <div> tags in xml file, , want process through of them, extracting results of different cuisines 1 text file. each line showing cuisines each <div> block.

thanks!

this basic bash script (using awk) job, @ least example provided:

#!/bin/bash     cat in.xml | awk ' /item cuisine/ {item=gensub(/<[^>]*>/, "", "g");      ans = (ans=="") ? item : ans ", " item;} end {print ans}' > out.txt

the script removes text inside brackets , retains text between them, , on lines containing "item cuisine".

however, note very fragile way of extracting values xml file, or, matter, data exchange format (like json, yaml etc.), , stop working dozen different reasons (bad xml format, xml line containing "item cuisine" term outside of brackets, xml tags not being broken newlines, etc.).

one extend above script , cover increasing number of errors, there's no need reinvent wheel has been done in better way. tools xmllint or xgrep offer more robust xml parsing, letting concentrate on task @ hand instead of error handling.

if more quick personal hack/experiment, i'd urge use 1 of available tools.


Comments

Post a Comment

Popular posts from this blog

node.js - Node js - Trying to send POST request, but it is not loading javascript content -

i have been trying send post request website, , has not been loading full site. i guessing problem node js not loading javascript content, executing it. can see javascript in response, though never loads content javascript files producing in html. what mean is, doesn't execute javascript. how make node js code overcome this, , wait the full website load? have tried native code, , "request' module, both producing same errors. if helps, don't need native javascript. modules fine. some code have tried (request module): var options = { method: 'post', uri: 'https://url', formdata: { 'email': 'email', 'prize': '0', 'transactional': 'on' }, headers: { /* 'content-type': 'application/x-www-form-urlencoded' */ // set automatically } }; rp(options) .then(function (body) { console.log(body) }) .catch(function (err) { console.log(err) }); when fetch content...
Read more

javascript - Replicate keyboard event with html button -

i have tried few ways make happen. have javascript pinball game uses keyboard keys controls. converting application touch screen display. workaround, hoping overlay buttons when clicked simulate keyboard strokes. have done research , sounds should work. using jquery v3.2.1 here things have tried far... html element: <input type="button" class="coil"></input> $('.coil').trigger({type: 'keydown', which: 40, keycode: 40}); with this, not errors, nothing happens. var coilkey = $('body').keydown(function(e) { switch (e.keycode) { case 40: break;} }) $('.coil').click(coilkey); this 1 returns error in console... ((jquery.event.special[handleobj.origtype] || (intermediate value)).handle || handleobj.handler).apply not function below javascript game engine handles key listeners... addkeylistener: function (keyandlistener) { this.keylisteners.push(keyandlistener); }, // gi...
Read more

javascript - Web audio api 5.1 surround example not working in firefox -

i've been playing lott lately web audio api on both firefox , chrome. few days ago started experiment surround set. when trying surround audio in web audio api came notice example works fine in chrome v59 not in firefox v54. // create web audio api context var audioctx = new (window.audiocontext || window.webkitaudiocontext)(); audioctx.destination.channelinterpretation = 'discrete'; audioctx.destination.channelcountmode = 'explicit'; audioctx.destination.channelcount = 6; var oscillators = []; var merger = audioctx.createchannelmerger(6); console.log(audioctx.destination, merger); //merger.channelinterpretation = 'discrete'; //merger.channelcountmode = 'explicit'; //merger.channelcount = 6; var addoscilator = function(channel, frequency) { var oscillator = audioctx.createoscillator(); oscillator.frequency.value = frequency; // value in hertz oscillator.connect(merger,0,channel); oscillator.start(); oscillators.push(o...
Read more