osx - Working with Arabic in Python on MacOS -


i'm working on project has data in arabic. 1 task requires me create database mapping dicts. don't read arabic, of google translate , original english versions of data, i'm able surmise arabic strings map database columns.

the problem i'm facing python / macos / seems converting ligatures (?) in arabic when use copy/paste on them, leads code not recognizing of dicts.

i believe have way around problem, given nature of work i'm doing, understand happening.

the original arabic key looks this:

original

however, when copy/paste on macos, converts following:

enter image description here

google translate, macos, safari, etc... seem think these equivalent text, python disagrees , throws keyerror when encounters original (due system having converted second version. if paste here, converts: الفئة

is there way work text @ system level not end being converted python doesn't recognize?

in case finds , runs similar problem...

what needed parse through 350k structured arabic records (though not same schema), extract key values, map them english database column names, , insert original records table. thinking laziness work, created set of unique keys, printed screen, copy/pasted text editor, converted dict, , used arabic words dict keys , english column names values. except, did not notice when pasted set of arabic field names system "fixed" arabic misspellings, resulting in key names no longer recognized when parsing records.

to fix problem, instead of printing arabic column names (there 32 of them) screen, created sqlite database , inserted them table included blank "standardized" column. went sqlite , updated records map english arabic. read table python , created lookup dict used when parsing full data payload. inserting arabic sqlite did not "correct" misspellings me, , hence, records extracted there served accurate lookup.

the lookup table ended looking this:

enter image description here

in spite of trying, never figured out how macos stop correcting misspelled arabic.


Comments

Post a Comment

Popular posts from this blog

node.js - Node js - Trying to send POST request, but it is not loading javascript content -

i have been trying send post request website, , has not been loading full site. i guessing problem node js not loading javascript content, executing it. can see javascript in response, though never loads content javascript files producing in html. what mean is, doesn't execute javascript. how make node js code overcome this, , wait the full website load? have tried native code, , "request' module, both producing same errors. if helps, don't need native javascript. modules fine. some code have tried (request module): var options = { method: 'post', uri: 'https://url', formdata: { 'email': 'email', 'prize': '0', 'transactional': 'on' }, headers: { /* 'content-type': 'application/x-www-form-urlencoded' */ // set automatically } }; rp(options) .then(function (body) { console.log(body) }) .catch(function (err) { console.log(err) }); when fetch content...
Read more

javascript - Replicate keyboard event with html button -

i have tried few ways make happen. have javascript pinball game uses keyboard keys controls. converting application touch screen display. workaround, hoping overlay buttons when clicked simulate keyboard strokes. have done research , sounds should work. using jquery v3.2.1 here things have tried far... html element: <input type="button" class="coil"></input> $('.coil').trigger({type: 'keydown', which: 40, keycode: 40}); with this, not errors, nothing happens. var coilkey = $('body').keydown(function(e) { switch (e.keycode) { case 40: break;} }) $('.coil').click(coilkey); this 1 returns error in console... ((jquery.event.special[handleobj.origtype] || (intermediate value)).handle || handleobj.handler).apply not function below javascript game engine handles key listeners... addkeylistener: function (keyandlistener) { this.keylisteners.push(keyandlistener); }, // gi...
Read more

javascript - Web audio api 5.1 surround example not working in firefox -

i've been playing lott lately web audio api on both firefox , chrome. few days ago started experiment surround set. when trying surround audio in web audio api came notice example works fine in chrome v59 not in firefox v54. // create web audio api context var audioctx = new (window.audiocontext || window.webkitaudiocontext)(); audioctx.destination.channelinterpretation = 'discrete'; audioctx.destination.channelcountmode = 'explicit'; audioctx.destination.channelcount = 6; var oscillators = []; var merger = audioctx.createchannelmerger(6); console.log(audioctx.destination, merger); //merger.channelinterpretation = 'discrete'; //merger.channelcountmode = 'explicit'; //merger.channelcount = 6; var addoscilator = function(channel, frequency) { var oscillator = audioctx.createoscillator(); oscillator.frequency.value = frequency; // value in hertz oscillator.connect(merger,0,channel); oscillator.start(); oscillators.push(o...
Read more