amazon web services - AWS CloudSearch Error Unmartialing Response -
i seem bumping against limitation cloudsearch can't figure out. working in .net , have situation there large number of 'playlists' allow in search, makes long query, seems work part. in cases getting error don't totally understand. here stack trace:
amazon.runtime.amazonunmarshallingexception: error unmarshalling response aws. ---> system.nullreferenceexception: object reference not set instance of object. @ amazon.runtime.internal.transform.jsonerrorresponseunmarshaller.unmarshall(jsonunmarshallercontext context) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\internal\transform\jsonerrorresponseunmarshaller.cs:line 103 @ amazon.cloudsearchdomain.model.internal.marshalltransformations.searchresponseunmarshaller.unmarshallexception(jsonunmarshallercontext context, exception innerexception, httpstatuscode statuscode) in e:\jenkinsworkspaces\v3-stage-release\awsdotnetpublic\sdk\src\services\cloudsearchdomain\generated\model\internal\marshalltransformations\searchresponseunmarshaller.cs:line 92 @ amazon.runtime.internal.transform.jsonresponseunmarshaller.unmarshallexception(unmarshallercontext input, exception innerexception, httpstatuscode statuscode) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\internal\transform\responseunmarshallers.cs:line 198 @ amazon.runtime.internal.httperrorresponseexceptionhandler.handleexception(iexecutioncontext executioncontext, httperrorresponseexception exception) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\errorhandler\httperrorresponseexceptionhandler.cs:line 78 --- end of inner exception stack trace --- @ amazon.runtime.internal.httperrorresponseexceptionhandler.handleexception(iexecutioncontext executioncontext, httperrorresponseexception exception) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\errorhandler\httperrorresponseexceptionhandler.cs:line 111 @ amazon.runtime.internal.exceptionhandler`1.handle(iexecutioncontext executioncontext, exception exception) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\errorhandler\exceptionhandler.cs:line 38 @ amazon.runtime.internal.errorhandler.processexception(iexecutioncontext executioncontext, exception exception) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\errorhandler\errorhandler.cs:line 204 @ amazon.runtime.internal.errorhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\errorhandler\errorhandler.cs:line 78 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.callbackhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\callbackhandler.cs:line 45 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.signer.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\signer.cs:line 38 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.credentialsretriever.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\credentialsretriever.cs:line 72 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.retryhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\retryhandler\retryhandler.cs:line 84 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.callbackhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\callbackhandler.cs:line 45 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.endpointresolver.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\endpointresolver.cs:line 34 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.marshaller.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\marshaller.cs:line 37 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.cloudsearchdomain.internal.processrequesthandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-stage-release\awsdotnetpublic\sdk\src\services\cloudsearchdomain\custom\internal\processrequesthandler.cs:line 26 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.callbackhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\callbackhandler.cs:line 45 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.errorcallbackhandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\errorcallbackhandler.cs:line 44 @ amazon.runtime.internal.pipelinehandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\pipelinehandler.cs:line 55 @ amazon.runtime.internal.metricshandler.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\handlers\metricshandler.cs:line 40 @ amazon.runtime.internal.runtimepipeline.invokesync(iexecutioncontext executioncontext) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\pipeline\runtimepipeline.cs:line 135 @ amazon.runtime.amazonserviceclient.invoke[trequest,tresponse](trequest request, imarshaller`2 marshaller, responseunmarshaller unmarshaller) in e:\jenkinsworkspaces\v3-trebuchet-release\awsdotnetpublic\sdk\src\core\amazon.runtime\amazonserviceclient.cs:line 192 @ amazon.cloudsearchdomain.amazoncloudsearchdomainclient.search(searchrequest request) in e:\jenkinsworkspaces\v3-stage-release\awsdotnetpublic\sdk\src\services\cloudsearchdomain\generated\_bcl35\amazoncloudsearchdomainclient.cs:line 132 @ sptr.gamut.data.aws.awscore.getsearchresult(string searchstring, int32& totalfound, list`1& facets, nullable`1 searchtype, boolean paginateaslist) in c:\rd\commercial software\spectrum\gamut\code\gamutbase\data\aws\awscore.cs:line 1427 @ sptr.gamut.searchvm.dosearch() in c:\rd\commercial software\spectrum\gamut\code\gamutbase\searchvm.cs:line 224 the thing is, if have no faceting in works fine, turn on facet gets error. if reduce 100 playlists instead of 150 , turn on faceting in works fine. leads me believe there type of limit it's hitting throwing error.
here data 1 got error:
query (structure parser): (or (term 'door') (prefix boost=0.25 'door') (and (or (term 'door') (prefix boost=0.25 'door')) (term field=favoritedusers boost=1.5 '9219cfe5-9756-45e7-ae15-b5ca73748404')))
filterquery: (and (or keynote:'08710') objecttype:'10' (or playlists:'9i2frcy8' playlists:'uwpvqyxh' playlists:'0qtvwena' playlists:'2gqii0go' playlists:'8qj8cgvw' playlists:'l8a56uvd' playlists:'8lf98mhe' playlists:'0f7giujd' playlists:'ut1qckaj' playlists:'h4dbj7s9' playlists:'c9mm1dm6' playlists:'mjp0frtb' playlists:'j2ndnbri' playlists:'f854hpfj' playlists:'tb6li0qt' playlists:'8ox2i76j' playlists:'9cwmleut' playlists:'ny6cev1u' playlists:'1m4x5i1x' playlists:'ge251k0f' playlists:'ylne2cy8' playlists:'nvwwpybx' playlists:'xy3vlw6k' playlists:'4je6ema4' playlists:'rxb4jvuf' playlists:'be0cqgih' playlists:'h448us7o' playlists:'fq6ruon1' playlists:'101svsr1' playlists:'ti3nqavr' playlists:'u0h2bspq' playlists:'usoj1juy' playlists:'8hrw4h8o' playlists:'gr4n8x6a' playlists:'k8qy3c5r' playlists:'3wcgj6qp' playlists:'slqorl5t' playlists:'y5tyrdgy' playlists:'681wh04e' playlists:'dvp6mqor' playlists:'r5fe7di4' playlists:'fmtm0hn2' playlists:'q96rvp4q' playlists:'5p8c1v8o' playlists:'vivmluko' playlists:'wtneponn' playlists:'qeok75fn' playlists:'jni0x45c' playlists:'y9oh506q' playlists:'sgu0t3ta' playlists:'llk4ic2w' playlists:'2o0rh2yn' playlists:'6nfvkcx2' playlists:'jyg2cymq' playlists:'olqvouu4' playlists:'8q2t2eoo' playlists:'jxu400y7' playlists:'uy7vi8f0' playlists:'p1deaf2h' playlists:'70t9gpra' playlists:'4x8xwypa' playlists:'xrwwdfo4' playlists:'xjwwydlm' playlists:'nmgdgjxp' playlists:'5n0galk7' playlists:'avg3g9w7' playlists:'4hi5qxbf' playlists:'82v4tmgr' playlists:'8kl1sguf' playlists:'2vm68mfv' playlists:'i2c5bt61' playlists:'ibdrl9w8' playlists:'dxnn2y0y' playlists:'faqqq80p' playlists:'tlsad9cx' playlists:'6xuqmi30' playlists:'qtkibnnv' playlists:'jgbp6ux7' playlists:'hmekjdg6' playlists:'scgkd7i7' playlists:'quup0wig' playlists:'ux42kss3' playlists:'828u9ir1' playlists:'bx8eevau' playlists:'mhe0g4a4' playlists:'mp15xd5c' playlists:'qedatlm7' playlists:'dxtbs3wy' playlists:'g5n8jtai' playlists:'dmbexfiq' playlists:'suvegdq7' playlists:'imx2ahs6' playlists:'3ijkufbe' playlists:'4keg8svd' playlists:'w24ddnig' playlists:'ytvlqovy' playlists:'xpwypcof' playlists:'wa8nnfck' playlists:'p7vv2osu' playlists:'s0tamtvw' playlists:'5322h108' playlists:'fcq853br' playlists:'ev4etn0y' playlists:'s71e1rq9' playlists:'t1bmhv5v' playlists:'wd54ybpa' playlists:'ta76327c' playlists:'6ca3h73p' playlists:'cv0dn0i0' playlists:'smil74bn' playlists:'1o1y133q' playlists:'4fr5cj6h' playlists:'49h3ybcc' playlists:'9g891fdi' playlists:'i01h0dit' playlists:'1n0mx1gs' playlists:'q2oea37k' playlists:'f0v6r6yn' playlists:'d1lao5gp' playlists:'bgaa5ix3' playlists:'lg4tttop' playlists:'2b8sl742' playlists:'6uqj5dl7' playlists:'3t9cb7wj' playlists:'gylul16i' playlists:'3xgjgmw7' playlists:'epk4pc39' playlists:'wmcmovnk' playlists:'ko2jphlb' playlists:'u87cgxct' playlists:'cs1lsia4' playlists:'i2jjsa7r' playlists:'rr3161xq' playlists:'d6oemfis' playlists:'4o8gd9he' playlists:'wrrl3e2s' playlists:'5bt9n80s' playlists:'2mwvrovm' playlists:'rc17tj4d' playlists:'y4sprfou' playlists:'06hluw5h' playlists:'d22u2nfn' playlists:'tx97dgvo' playlists:'2kb85l0g' playlists:'30amwf4j' playlists:'u3yu0euy' playlists:'sh9sf9yj' playlists:'cbah1wub' playlists:'kbbwdo2p' playlists:'xio2uj1m' playlists:'eshkknye'))
facet: {"category":{}, "assemblycode":{}, "keynote":{buckets:["08710"]}, "omniclass":{}, "playlists":{}, "status":{}, "workplanebased":{}, "host":{}, "sourcefile":{}}
query options: {"fields":["assemblycode^1","assemblydescription^1","category^1","filename^1.5","keynote^1","keywords^1.5","name^1.5","omniclass^1","omniclasstitle^1","parametersearchvalues^0.5"]}
i have found page http://docs.aws.amazon.com/cloudsearch/latest/developerguide/limits.html , looked on it. don't see limit hitting. don't have 1024 clauses, have 150. max 8190 bytes; have added strings , comes 3500 characters. don't know how cloudsearch api formats doubt more double length.
can tell me issue i'm hitting? there way in .net sdk count bytes sure i'm not hitting that?
ok still don't know limitation found way work around it. i'm posting here answer else dealing situation or similar, if knows limitation i'm hitting or how deal better i'll accept answer...
so ended breaking search multiple requests. if list of playlists on 100 broke chunks of 100 playlists , submitted request each chunk. took result sets each , put them final result set. works few items aware of if going use method:
- of course it's little slower searching multiple times instead of once.
- if paginating need store each search request/response object next set instead of 1 , same thing when getting next page.
- search quality may reduced. if pull top 5 2 different groups there no guarantee top 10 whole. top 5 group 2 may ranked 30-35 in overall show 6-10 in split result set.
in case while these aren't ideal acceptable limitations...
Comments
Post a Comment