LSTM: Training: Deserialize Failed

I added  -eval_listfile /home/shree/tesstutorial/hineval/tmp.txt \ to my lstmtraining command once it had come down to less than 3%char error.
While training is continuing, I am getting messages saying 'Deserialize Failed',

Lines with error:
At iteration 23765/35800/35801,
Mean rms=0.111%, delta=0.79%, char train=2.554%, word train=14.083%, skip ratio=0%,
wrote checkpoint.

2 Percent improvement time=15025, best error was 4.481 @ 8791
Warning: LSTMTrainer deserialized an LSTMRecognizer!
At iteration 23816/35900/35901,
Mean rms=0.11%, delta=0.768%, char train=2.454%, word train=13.982%, skip ratio=0%,
New best char error = 2.454
Deserialize failed
wrote best model:/home/shree/tesstutorial/hinlayer_from_hin/hinlayer2.454_23816.lstm
wrote checkpoint.

...

Loaded 61/61 pages (1-61) of document /home/shree/tesstutorial/hineval/hin.Sahitya.exp0.lstmf
2 Percent improvement time=14846,
best error was 4.436 @ 9020
At iteration 23866/36000/36001,
Mean rms=0.11%, delta=0.749%, char train=2.396%, word train=14.124%, skip ratio=0%,
New best char error = 2.396
Previous test incomplete, skipping test at iteration23816
wrote checkpoint.

...

At iteration 23914/36100/36101,
Mean rms=0.11%, delta=0.747%, char train=2.41%, word train=14.399%, skip ratio=0%,
New worst char error = 2.41
At iteration 23618, stage 1,
Eval Char error rate=1.8365727, Word error rate=7.0471499 wrote checkpoint.

...

At iteration 24320/36900/36901,
Mean rms=0.109%, delta=0.745%, char train=2.454%, word train=14.204%, skip ratio=0%,
New worst char error = 2.454
Deserialize failed wrote checkpoint.

...

2 Percent improvement time=15369,
best error was 4.329 @ 9223
At iteration 24592/37400/37401,
Mean rms=0.108%, delta=0.737%, char train=2.298%, word train=13.478%, skip ratio=0%,
New best char error = 2.298
wrote best model:/home/shree/tesstutorial/hinlayer_from_hin/hinlayer2.298_24592.lstm wrote checkpoint.

The eval files and training files are built with different training texts and have different unicharsets.
Is this error 'fatal' for training?

This is still happening with the latest code - the eval file was built using a different training text.
git log -1
commit d18931e86ed9b8fc40299d5494b53901310b4867
Date:   Fri May 5 16:42:44 2017 -0700
Fixed int types for imported tf networks
  lstmtraining \
>   -U ~/tesstutorial/bihnew/bih.unicharset \
>   --train_listfile ~/tesstutorial/bihnew/bih.training_files.txt \
>   --eval_listfile ~/tesstutorial/bihtest/bih.training_files.txt \
>   --continue_from ~/tesstutorial/bihnewlayer/bih.lstm \
>   --model_output ~/tesstutorial/bihnewlayer/bihlayer \
>   --script_dir ../langdata \
>  --append_index 5 \
>  --net_spec '[Lfx384 O1c105]' \
>  --target_error_rate 0.01 \
>  --debug_interval -1
Loaded file /home/shree/tesstutorial/bihnewlayer/bih.lstm, unpacking...
Warning: LSTMTrainer deserialized an LSTMRecognizer!
Continuing from /home/shree/tesstutorial/bihnewlayer/bih.lstm
Appending a new network to an old one!!Setting unichar properties
Setting properties for script Common
Setting properties for script Latin
Setting properties for script Devanagari
Setting properties for script Han
Warning: given outputs 105 not equal to unicharset of 145.
Num outputs,weights in serial:
  Lfx384:384, 787968
  Fc145:145, 55825
Total weights = 843793
Built network:[1,0,0,1[C5,5Ft16]Mp3,3Lfys64Lfx128Lrx128Lfx384Fc145] from request [Lfx384 O1c105]
Training parameters:
  Debug interval = -1, weights = 0.1, learning rate = 0.0001, momentum=0.9
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.AA_NAGARI_SHREE_L3.exp0.lstmf
Loaded 199/199 pages (1-199) of document /home/shree/tesstutorial/bihtest/bih.Chandas.exp0.lstmf
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.Adobe_Devanagari.exp0.lstmf
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.CDAC-GISTSurekh.exp0.lstmf
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.Aksharyogini2.exp0.lstmf
Loaded 411/411 pages (1-411) of document /home/shree/tesstutorial/bihnew/bih.CDAC-GISTYogesh.exp0.lstmf
Loaded 405/405 pages (1-405) of document /home/shree/tesstutorial/bihnew/bih.Annapurna_SIL.exp0.lstmf
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.Arial_Unicode_MS.exp0.lstmf
Loaded 404/404 pages (1-404) of document /home/shree/tesstutorial/bihnew/bih.Aparajita.exp0.lstmf
Loaded 472/472 pages (1-472) of document /home/shree/tesstutorial/bihnew/bih.Chandas.exp0.lstmf
Loaded 202/202 pages (1-202) of document /home/shree/tesstutorial/bihtest/bih.FreeSerif.exp0.lstmf

At iteration 100/100/100, Mean rms=5.4%, delta=52.955%, char train=110.663%, word train=100%, skip ratio=0%,  New worst char error = 110.663 wrote checkpoint.
At iteration 200/200/200, Mean rms=5.254%, delta=50.469%, char train=105.319%, word train=100%, skip ratio=0%,  New worst char error = 105.319 wrote checkpoint.
At iteration 300/300/300, Mean rms=5.209%, delta=49.853%, char train=103.546%, word train=100%, skip ratio=0%,  New worst char error = 103.546 wrote checkpoint.
At iteration 400/400/400, Mean rms=5.189%, delta=49.729%, char train=102.636%, word train=100%, skip ratio=0%,  New worst char error = 102.636 wrote checkpoint.
At iteration 500/500/500, Mean rms=5.147%, delta=48.821%, char train=102.064%, word train=100%, skip ratio=0%,  New worst char error = 102.064 wrote checkpoint.
At iteration 600/600/600, Mean rms=5.127%, delta=48.496%, char train=101.601%, word train=99.991%, skip ratio=0%,  New worst char error = 101.601 wrote checkpoint.
At iteration 700/700/700, Mean rms=5.107%, delta=48.218%, char train=101.236%, word train=99.992%, skip ratio=0%,  New worst char error = 101.236 wrote checkpoint.
At iteration 800/800/800, Mean rms=5.081%, delta=47.738%, char train=100.547%, word train=99.986%, skip ratio=0%,  New worst char error = 100.547 wrote checkpoint.
At iteration 899/900/900, Mean rms=5.06%, delta=47.379%, char train=100.071%, word train=99.983%, skip ratio=0%,  New worst char error = 100.071 wrote checkpoint.
At iteration 999/1000/1000, Mean rms=5.038%, delta=46.991%, char train=99.425%, word train=99.985%, skip ratio=0%,  New best char error = 99.425 wrote checkpoint.
At iteration 1098/1100/1100, Mean rms=4.971%, delta=45.696%, char train=97.6%, word train=99.979%, skip ratio=0%,  New best char error = 97.6Deserialize failed wrote che
At iteration 1197/1200/1200, Mean rms=4.932%, delta=44.848%, char train=96.57%, word train=99.979%, skip ratio=0%,  New best char error = 96.57Deserialize failed wrote c
At iteration 1296/1300/1300, Mean rms=4.7%, delta=40.982%, char train=90.782%, word train=98.025%, skip ratio=0%,  New best char error = 90.782Deserialize failed wrote c
At iteration 1392/1400/1400, Mean rms=4.388%, delta=36.654%, char train=83.142%, word train=93.749%, skip ratio=0%,  New best char error = 83.142Deserialize failed wrote
At iteration 1491/1500/1500, Mean rms=4.053%, delta=32.455%, char train=74.886%, word train=88.3%, skip ratio=0%,  New best char error = 74.886Deserialize failed wrote c
At iteration 1582/1600/1600, Mean rms=3.71%, delta=28.11%, char train=66.546%, word train=82.7%, skip ratio=0%,  New best char error = 66.546Deserialize failed wrote bes
At iteration 1678/1700/1700, Mean rms=3.366%, delta=23.795%, char train=58.181%, word train=76.531%, skip ratio=0%,  New best char error = 58.181Deserialize failed wrote
At iteration 1772/1800/1800, Mean rms=3.018%, delta=19.642%, char train=49.915%, word train=70.119%, skip ratio=0%,  New best char error = 49.915Deserialize failed wrote
At iteration 1862/1900/1900, Mean rms=2.67%, delta=15.494%, char train=41.584%, word train=63.451%, skip ratio=0%,  New best char error = 41.584Deserialize failed wrote
At iteration 1955/2000/2000, Mean rms=2.321%, delta=11.413%, char train=33.335%, word train=56.515%, skip ratio=0%,  New best char error = 33.335Deserialize failed wrote
At iteration 2049/2100/2101, Mean rms=1.978%, delta=7.632%, char train=25.213%, word train=49.514%, skip ratio=0.1%,  New best char error = 25.213Deserialize failed wrot
At iteration 2137/2200/2201, Mean rms=1.631%, delta=3.903%, char train=17.289%, word train=42.271%, skip ratio=0.1%,  New best char error = 17.289Deserialize failed wrot
At iteration 2230/2300/2301, Mean rms=1.474%, delta=3.148%, char train=14.004%, word train=36.724%, skip ratio=0.1%,  New best char error = 14.004Deserialize failed wrot
At iteration 2319/2400/2402, Mean rms=1.394%, delta=2.795%, char train=12.74%, word train=33.555%, skip ratio=0.2%,  New best char error = 12.74Deserialize failed wrote
At iteration 2404/2500/2502, Mean rms=1.358%, delta=2.723%, char train=12.119%, word train=31.97%, skip ratio=0.2%,  New best char error = 12.119Deserialize failed wrote
At iteration 2492/2600/2602, Mean rms=1.319%, delta=2.621%, char train=11.425%, word train=30.027%, skip ratio=0.2%,  New best char error = 11.425Deserialize failed wrot
At iteration 2575/2700/2702, Mean rms=1.28%, delta=2.513%, char train=10.8%, word train=28.452%, skip ratio=0.2%,  New best char error = 10.8Deserialize failed wrote bes
At iteration 2663/2800/2802, Mean rms=1.251%, delta=2.453%, char train=10.291%, word train=26.924%, skip ratio=0.2%,  New best char error = 10.291Deserialize failed wrot
At iteration 2751/2900/2902, Mean rms=1.228%, delta=2.404%, char train=9.908%, word train=25.807%, skip ratio=0.2%,  New best char error = 9.908Deserialize failed Transi
At iteration 2835/3000/3002, Mean rms=1.208%, delta=2.404%, char train=9.642%, word train=24.994%, skip ratio=0.2%,  New best char error = 9.642Deserialize failed wrote
At iteration 2913/3100/3102, Mean rms=1.19%, delta=2.426%, char train=9.431%, word train=24.268%, skip ratio=0.1%,  New best char error = 9.431Deserialize failed wrote b
At iteration 2999/3200/3202, Mean rms=1.185%, delta=2.482%, char train=9.255%, word train=23.749%, skip ratio=0.1%,  New best char error = 9.255Deserialize failed wrote
At iteration 3078/3300/3302, Mean rms=1.166%, delta=2.434%, char train=9.033%, word train=23.091%, skip ratio=0.1%,  New best char error = 9.033Deserialize failed wrote
At iteration 3166/3400/3404, Mean rms=1.159%, delta=2.419%, char train=8.759%, word train=22.778%, skip ratio=0.2%,  New best char error = 8.759Deserialize failed wrote
At iteration 3252/3500/3504, Mean rms=1.14%, delta=2.378%, char train=8.455%, word train=21.739%, skip ratio=0.2%,  New best char error = 8.455Deserialize failed wrote b
At iteration 3339/3600/3604, Mean rms=1.116%, delta=2.296%, char train=8.126%, word train=20.904%, skip ratio=0.2%,  New best char error = 8.126Deserialize failed wrote
At iteration 3417/3700/3704, Mean rms=1.113%, delta=2.345%, char train=8.138%, word train=20.69%, skip ratio=0.2%,  New worst char error = 8.138Deserialize failed wrote
At iteration 3494/3800/3804, Mean rms=1.098%, delta=2.306%, char train=8.236%, word train=20.183%, skip ratio=0.2%,  New worst char error = 8.236 wrote checkpoint.
At iteration 3572/3900/3905, Mean rms=1.079%, delta=2.251%, char train=8.022%, word train=19.734%, skip ratio=0.3%,  New best char error = 8.022 wrote checkpoint.
At iteration 3650/4000/4005, Mean rms=1.062%, delta=2.155%, char train=7.816%, word train=19.132%, skip ratio=0.3%,  New best char error = 7.816Deserialize failed wrote
At iteration 3730/4100/4105, Mean rms=1.052%, delta=2.124%, char train=7.667%, word train=18.616%, skip ratio=0.3%,  New best char error = 7.667Deserialize failed wrote
At iteration 3812/4200/4205, Mean rms=1.03%, delta=2.018%, char train=7.424%, word train=17.952%, skip ratio=0.3%,  New best char error = 7.424Deserialize failed wrote b
At iteration 3895/4300/4305, Mean rms=1.02%, delta=1.963%, char train=7.243%, word train=17.678%, skip ratio=0.3%,  New best char error = 7.243Deserialize failed wrote c
At iteration 3972/4400/4405, Mean rms=1.006%, delta=1.918%, char train=7.117%, word train=17.048%, skip ratio=0.1%,  New best char error = 7.117Deserialize failed wrote
At iteration 4056/4500/4505, Mean rms=1.012%, delta=2.06%, char train=7.335%, word train=17.354%, skip ratio=0.1%,  New worst char error = 7.335Deserialize failed wrote
At iteration 4136/4600/4605, Mean rms=1.014%, delta=2.085%, char train=7.377%, word train=17.564%, skip ratio=0.1%,  New worst char error = 7.377 wrote checkpoint.
At iteration 4215/4700/4705, Mean rms=1.01%, delta=2.07%, char train=7.279%, word train=17.42%, skip ratio=0.1%,  New worst char error = 7.279 wrote checkpoint.
At iteration 4283/4800/4805, Mean rms=1.007%, delta=2.083%, char train=7.042%, word train=17.433%, skip ratio=0.1%,  New best char error = 7.042 wrote checkpoint.
At iteration 4363/4900/4905, Mean rms=1.002%, delta=2.037%, char train=6.828%, word train=17.179%, skip ratio=0%,  New best char error = 6.828Deserialize failed wrote be

@stweil Is it related to https://github.com/tesseract-ocr/tesseract/issues/881#issuecomment-299393920 ?

Maybe, I don't know. First I have to reproduce this.

@stweil In case you want to reproduce using the files I was using - they are for Bihari/Hindi language, devanagari script.
http://sanskritdocuments.org/hindi/bihtest.zip
http://sanskritdocuments.org/hindi/bihnew.zip
Zip file was too large to upload here or on my github account.

~/tesstutorial/bihnewlayer is needed, too.

mkdir -p ~/tesstutorial/bihnewlayer
combine_tessdata -e ../tessdata/hin.traineddata
~/tesstutorial/bihnewlayer/bih.lstm

~/tesstutorial/bihnewlayer is needed, too.

http://sanskritdocuments.org/hindi/bihnewlayer.zip
it has:

bih.lstm (lstm model extracted from hin.traineddata)
bihlayer_checkpoint (current status of the model)
bihlayer4.005_8369.lstm (latest 'best' model)

I have not included all other intermediate .lstm files, since each is 33+ MB.

I had to fix the path in ~/tesstutorial/bihtest/bih.training_files.txt, but now lstmtraining works, and there seem to be no errors. Tested with debug version based on latest git master.

Thanks for checking, @stweil. I will rebuild with the latest git master and test again as I am still getting Deserialize Failed messages, though not for every checkpoint iteration of training.
Maybe, these are also just 'info' messages!
At iteration 8306/10800/10808, Mean rms=0.765%, delta=1.311%, char train=4.216%, word train=10.221%, skip ratio=0.2%,  New best char error = 4.216 wrote best model:/ho
At iteration 8369/10900/10908, Mean rms=0.753%, delta=1.217%, char train=4.005%, word train=10.036%, skip ratio=0.2%,  New best char error = 4.005Deserialize failed wr
At iteration 8426/11000/11008, Mean rms=0.752%, delta=1.211%, char train=4.014%, word train=9.962%, skip ratio=0.2%,  New worst char error = 4.014Deserialize failed wr
At iteration 8482/11100/11109, Mean rms=0.768%, delta=1.319%, char train=4.281%, word train=10.389%, skip ratio=0.3%,  New worst char error = 4.281 wrote checkpoint.
At iteration 8548/11200/11210, Mean rms=0.773%, delta=1.355%, char train=4.347%, word train=10.64%, skip ratio=0.3%,  New worst char error = 4.347 wrote checkpoint.
At iteration 8607/11300/11310, Mean rms=0.772%, delta=1.37%, char train=4.4%, word train=10.701%, skip ratio=0.3%,  New worst char error = 4.4 wrote checkpoint.
At iteration 8666/11400/11410, Mean rms=0.777%, delta=1.359%, char train=4.394%, word train=10.81%, skip ratio=0.3%,  New worst char error = 4.394 wrote checkpoint.
At iteration 8729/11500/11510, Mean rms=0.772%, delta=1.368%, char train=4.385%, word train=10.801%, skip ratio=0.2%,  New worst char error = 4.385 wrote checkpoint.
At iteration 8794/11600/11610, Mean rms=0.772%, delta=1.343%, char train=4.354%, word train=10.848%, skip ratio=0.2%,  New worst char error = 4.354 wrote checkpoint.
At iteration 8857/11700/11710, Mean rms=0.786%, delta=1.415%, char train=4.538%, word train=11.094%, skip ratio=0.2%,  New worst char error = 4.538 wrote checkpoint.
At iteration 8919/11800/11810, Mean rms=0.802%, delta=1.531%, char train=4.968%, word train=11.586%, skip ratio=0.2%,  New worst char error = 4.968 wrote checkpoint.
At iteration 8979/11900/11910, Mean rms=0.8%, delta=1.548%, char train=5.043%, word train=11.359%, skip ratio=0.2%,  New worst char error = 5.043 wrote checkpoint.
At iteration 9034/12000/12010, Mean rms=0.79%, delta=1.526%, char train=4.924%, word train=11.199%, skip ratio=0.2%,  New worst char error = 4.924 wrote checkpoint.
At iteration 9101/12100/12110, Mean rms=0.781%, delta=1.449%, char train=4.766%, word train=11.043%, skip ratio=0.1%,  New worst char error = 4.766 wrote checkpoint.
At iteration 9160/12200/12210, Mean rms=0.784%, delta=1.443%, char train=4.801%, word train=11.025%, skip ratio=0%,  New worst char error = 4.801 wrote checkpoint.
At iteration 9224/12300/12310, Mean rms=0.784%, delta=1.444%, char train=4.728%, word train=10.783%, skip ratio=0%,  New worst char error = 4.728 wrote checkpoint.
At iteration 9285/12400/12410, Mean rms=0.782%, delta=1.477%, char train=4.773%, word train=10.693%, skip ratio=0%,  New worst char error = 4.773 wrote checkpoint.
At iteration 9349/12500/12511, Mean rms=0.776%, delta=1.419%, char train=4.545%, word train=10.359%, skip ratio=0.1%,  New worst char error = 4.545 wrote checkpoint.
At iteration 9405/12600/12611, Mean rms=0.769%, delta=1.421%, char train=4.498%, word train=10.172%, skip ratio=0.1%,  New worst char error = 4.498 wrote checkpoint.
At iteration 9461/12700/12711, Mean rms=0.749%, delta=1.324%, char train=4.276%, word train=9.825%, skip ratio=0.1%,  wrote checkpoint.
At iteration 9518/12800/12811, Mean rms=0.737%, delta=1.229%, char train=3.922%, word train=9.583%, skip ratio=0.1%,  New best char error = 3.922Previous test incomple
At iteration 9576/12900/12911, Mean rms=0.733%, delta=1.198%, char train=3.746%, word train=9.473%, skip ratio=0.1%,  New best char error = 3.746Previous test incomple
At iteration 9641/13000/13011, Mean rms=0.743%, delta=1.261%, char train=4.006%, word train=9.773%, skip ratio=0.1%,  New worst char error = 4.006Previous test incompl
At iteration 9708/13100/13111, Mean rms=0.742%, delta=1.255%, char train=3.899%, word train=9.567%, skip ratio=0.1%,  New worst char error = 3.899Previous test incompl
At iteration 9766/13200/13211, Mean rms=0.727%, delta=1.193%, char train=3.708%, word train=9.23%, skip ratio=0.1%,  New best char error = 3.708Previous test incomplet
At iteration 9822/13300/13311, Mean rms=0.727%, delta=1.191%, char train=3.717%, word train=9.477%, skip ratio=0.1%,  New worst char error = 3.717Previous test incompl
At iteration 9880/13400/13411, Mean rms=0.723%, delta=1.151%, char train=3.603%, word train=9.355%, skip ratio=0.1%,  New best char error = 3.603At iteration 8369, sta
ge 1, Eval Char error rate=2.0568204, Word error rate=4.3746914 wrote best model:/home/shree/tesstutorial/bihnewlayer/bihlayer3.603_9880.lstm wrote checkpoint.
At iteration 9934/13500/13511, Mean rms=0.725%, delta=1.203%, char train=3.786%, word train=9.603%, skip ratio=0%,  New worst char error = 3.786Deserialize failed wrot
At iteration 9988/13600/13611, Mean rms=0.733%, delta=1.237%, char train=4.018%, word train=9.875%, skip ratio=0%,  New worst char error = 4.018 wrote checkpoint.
At iteration 10036/13700/13711, Mean rms=0.737%, delta=1.256%, char train=4.052%, word train=10.005%, skip ratio=0%,  New worst char error = 4.052 wrote checkpoint.

I had to fix the path in ~/tesstutorial/bihtest/bih.training_files.txt,

Did you need to change path in both to match your setup?

--train_listfile ~/tesstutorial/bihnew/bih.training_files.txt
--eval_listfile ~/tesstutorial/bihtest/bih.training_files.txt \

or did you change path in bihtest to match bihnew?
I think the problem occurs when the training files and evaluation files are different. The lstmf files in bihnew and bihtest were created using different training texts and font combos.

Yes, I changes both files to match my home directory.

Thanks, @stweil . However, now I am getting the error that you got when using lstmf files from a different version.
@theraysmith I am getting these errors when I use lstmf files created before the commits regarding endianness. However, the location of error is different from the rest reported above in this thread.
 lstmtraining  \
>    -U ~/tesstutorial/nyd/eng.unicharset \
>   --train_listfile ~/tesstutorial/nyd/nyd.training_files.txt \
>   --script_dir ../langdata   \
>   --append_index 5 --net_spec '[Lfx256 O1c105]' \
>   --continue_from ~/tesstutorial/nydlayer/eng.lstm \
>   --model_output ~/tesstutorial/nydlayer/nyd \
>   --debug_interval -1 \
>   --target_error_rate 0.01
Loaded file /home/shree/tesstutorial/nydlayer/eng.lstm, unpacking...
Warning: LSTMTrainer deserialized an LSTMRecognizer!
Continuing from /home/shree/tesstutorial/nydlayer/eng.lstm
Appending a new network to an old one!!Setting unichar properties
Setting properties for script Common
Setting properties for script Latin
Warning: given outputs 105 not equal to unicharset of 75.
Num outputs,weights in serial:
  Lfx256:256, 394240
  Fc75:75, 19275
Total weights = 413515
Built network:[1,0,0,1[C5,5Ft16]Mp3,3Lfys64Lfx128Lrx128Lfx256Fc75] from request [Lfx256 O1c105]
Training parameters:
  Debug interval = -1, weights = 0.1, learning rate = 0.0001, momentum=0.9
Deserialize failed: /home/shree/tesstutorial/nyd/eng.1852nydir.exp1.lstmf read 0/8 pages

@stweil @theraysmith
I tried running using the latest code with enable-debug option - earlier the error was 'deserialize failed' - please see https://github.com/tesseract-ocr/tesseract/issues/792#issuecomment-299809206
With --enable-debug, I get core dumped (same as https://github.com/tesseract-ocr/tesseract/issues/561)
Iteration 13398: ALIGNED TRUTH : पंचाग कला की, फ़ अः ग़ुमान आलोचना छूटती के ज़् द्वा अधीन र्द् देहियाँ भजनला
Iteration 13398: BEST OCR TEXT : पंचाग कला की, फ़ अः गुमान आलोचना छूटती के ज़् द्वा अधीन र्द् देहियाँ भजनला
File /tmp/tmp.3zBjAvGc9O/bih/bih.Lohit_Devanagari.exp0.lstmf page 24 :
Mean rms=0.723%, delta=1.151%, train=3.605%(9.362%), skip ratio=0.1%
Iteration 13399: ALIGNED TRUTH : संभावना :
Iteration 13399: BEST OCR TEXT : संभावना :
File /tmp/tmp.3zBjAvGc9O/bih/bih.Mangal.exp0.lstmf page 458 (Perfect):
Mean rms=0.723%, delta=1.151%, train=3.603%(9.355%), skip ratio=0.1%
lstmtraining: ../ccutil/genericvector.h:697: T& GenericVector<T>::operator[](int) const [with T = char]: Assertion `index >= 0 && index < size_used_' failed.
Aborted (core dumped)

gdb output pasted below:
Iteration 13399: ALIGNED TRUTH : संभावना :
Iteration 13399: BEST OCR TEXT : संभावना :
File /tmp/tmp.3zBjAvGc9O/bih/bih.Mangal.exp0.lstmf page 458 (Perfect):
Mean rms=0.723%, delta=1.151%, train=3.603%(9.355%), skip ratio=0.1%
[Thread 0x7fe0cd3e0700 (LWP 135) exited]
[New Thread 0x7fe0cd3e0700 (LWP 136)]
lstmtraining: ../ccutil/genericvector.h:697: T& GenericVector<T>::operator[](int) const [with T = char]: Assertion `index >= 0 && index < size_used_' failed.

Program received signal SIGABRT, Aborted.
[Switching to Thread 0x7fe0cd3e0700 (LWP 136)]
0x00007fe0d2886c37 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56      ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) backtrace
#0  0x00007fe0d2886c37 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1  0x00007fe0d288a028 in __GI_abort () at abort.c:89
#2  0x00007fe0d287fbf6 in __assert_fail_base (fmt=0x7fe0d29d03b8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",
    assertion=assertion@entry=0x7fe0d370d6c0 "index >= 0 && index < size_used_", file=file@entry=0x7fe0d370d148 "../ccutil/genericvector.h", line=line@entry=697,
    function=function@entry=0x7fe0d372ea60 <_ZZNK13GenericVectorIcEixEiE19__PRETTY_FUNCTION__> "T& GenericVector<T>::operator[](int) const [with T = char]")
    at assert.c:92
#3  0x00007fe0d287fca2 in __GI___assert_fail (assertion=0x7fe0d370d6c0 "index >= 0 && index < size_used_", file=0x7fe0d370d148 "../ccutil/genericvector.h", line=697,
    function=0x7fe0d372ea60 <_ZZNK13GenericVectorIcEixEiE19__PRETTY_FUNCTION__> "T& GenericVector<T>::operator[](int) const [with T = char]") at assert.c:101
#4  0x00007fe0d368c803 in GenericVector<char>::operator[] (this=<optimized out>, this=<optimized out>, index=0) at ../ccutil/genericvector.h:697
#5  0x00007fe0d368cfb8 in operator[] (this=0x7fffcf2d0bc0, this=0x7fffcf2d0bc0, index=0) at lstmtrainer.cpp:920
#6  tesseract::LSTMTrainer::ReadTrainingDump (this=this@entry=0x7fe0cd3df640, data=..., trainer=trainer@entry=0x7fe0cd3df640) at lstmtrainer.cpp:921
#7  0x000000000040b03e in tesseract::LSTMTester::RunEvalSync (this=this@entry=0x7fffcf2d0b50, iteration=9766, training_errors=<optimized out>, model_data=...,
    training_stage=1) at lstmtester.cpp:86
#8  0x000000000040b539 in tesseract::LSTMTester::ThreadFunc (lstmtester_void=0x7fffcf2d0b50) at lstmtester.cpp:123
#9  0x00007fe0d0748184 in start_thread (arg=0x7fe0cd3e0700) at pthread_create.c:312
#10 0x00007fe0d294a37d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
(gdb) up
#1  0x00007fe0d288a028 in __GI_abort () at abort.c:89
89      abort.c: No such file or directory.
(gdb) up
#2  0x00007fe0d287fbf6 in __assert_fail_base (fmt=0x7fe0d29d03b8 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",
    assertion=assertion@entry=0x7fe0d370d6c0 "index >= 0 && index < size_used_", file=file@entry=0x7fe0d370d148 "../ccutil/genericvector.h", line=line@entry=697,
    function=function@entry=0x7fe0d372ea60 <_ZZNK13GenericVectorIcEixEiE19__PRETTY_FUNCTION__> "T& GenericVector<T>::operator[](int) const [with T = char]")
    at assert.c:92

...

(gdb) up
#7  0x000000000040b03e in tesseract::LSTMTester::RunEvalSync (this=this@entry=0x7fffcf2d0b50, iteration=9766, training_errors=<optimized out>, model_data=...,
    training_stage=1) at lstmtester.cpp:86
86        if (!trainer.ReadTrainingDump(model_data, &trainer)) {
(gdb) print model_data
$10 = (const GenericVector<char> &) @0x7fffcf2d0bc0: {static kDefaultVectorSize = <optimized out>, size_used_ = 0, size_reserved_ = 0, data_ = 0x0, clear_cb_ = 0x0,
  compare_cb_ = 0x0}

@stweil was not able to reproduce this - https://github.com/tesseract-ocr/tesseract/issues/792#issuecomment-299780420
The only difference I can see would be that I run the program under WSL (bash on windows 10).

Duplicate https://github.com/tesseract-ocr/tesseract/issues/644

Still getting the error:
At iteration 800/800/802, Mean rms=0.934%, delta=47.138%, char train=100.525%, word train=100%, skip ratio=0.25%,  New worst char error = 100.525 wrote checkpoint.
Compute CTC targets failed!
At iteration 900/900/903, Mean rms=0.932%, delta=46.952%, char train=100.461%, word train=99.972%, skip ratio=0.333%,  New worst char error = 100.461 wrote checkpoint.
Warning: data size is zero in LSTMTrainer::ReadTrainingDump
At iteration 1000/1000/1003, Mean rms=0.93%, delta=46.74%, char train=100.415%, word train=99.975%, skip ratio=0.3%,  New worst char error = 100.415 wrote checkpoint.
Warning: LSTMTrainer deserialized an LSTMRecognizer!
2 Percent improvement time=1098, best error was 100 @ 0
Compute CTC targets failed!
Compute CTC targets failed!
At iteration 1098/1100/1103, Mean rms=0.917%, delta=45.445%, char train=99.984%, word train=99.975%, skip ratio=0.3%,  New best char error = 99.984

Deserialize failed wrote checkpoint.

ref: https://travis-ci.org/Shreeshrii/tess4train/builds/252343478

Is this issue still present with the latest code?

Closing Issue since LSTM training process has changed and so it is difficult to duplicate the issue.


too much time taking while loading

hi, while i move to this daterangepicker page it has taken too much time..

hi @somasudhan! were there any bugs to report, or can you be a little more specific? thanks!

@nebulousdog  thanks for your reply.
developing angular 2 application and using your date picker. other page loaded 500ms. bt while moving this datepicker page its taking more than 5 seconds to loading sometimes more than 10s. if i disable your date picker its loading within 500ms.

@somasudhan Are you hosting it yourself or using a cdn?

installed it through npm
On Tue, Jul 7, 2020 at 11:19 PM adjenks<EMAIL_ADDRESS>wrote:

@somasudhan https://github.com/somasudhan Are you hosting it yourself
or using a cdn?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/sensortower/daterangepicker/issues/44#issuecomment-655023268,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEHFTA5Z2MOGIMIEPD7WRNDR2NN37ANCNFSM4FCTOBBA
.


Install public version of spartacus

we need a public spartacus to do real testing on mobile. we didn't want to rely on deploying spartacus thru modelt.

We need someone with admin access to enable github-pages for our repo

Pull request #181

Blocked by #291

Pull request #319

Public version of Spartacus courtesy of github pages. You can check it out here:
https://sap.github.io/cloud-commerce-spartacus-storefront/
It will be updated every time we do a merge to develop
It uses our public model t as a backend (the same one that we use for e2e tests)

Created a doc follow-up ticket: GH-496. Moving this ticket to QA.

created bug #548
Doesn't work on chrome for some people


Error

comments

Can you share the context of each file added and methods that you added? I think some functions are not general usage and I don't know why you delete some pictures.


Error "not blessed" needs to be more descriptive

A lot of the frequent offenders here got fixed recently, but not closing as we could still clarify the issue where it still occurs. Watching for any recurrences.


[performance-testing] Separate out Session Database to another Database Instance

Describe the issue:

In production systems, separate database instances are used for independent scaling requirements.
We need to replicate this in performance testing as well to get performance test results that represent actual production systems

Related PR:

https://github.com/wso2/performance-is/pull/178


Send requests / responses to laravel telescope?

Hi, first thanks for the nice package, but as always it's still room to improve it.
Laravel telescope has a really nice feature HTTP Client watcher records outgoing HTTP client requests made by your application.

Is it plan to send requests / responses to laravel telescope?

Hi @rrolla!
Oooh, I wasn't aware of this but its something that can definitely be done. I will add it to my list.

Hey @rrolla,
I've been having a play with Telescope tonight, and thanks for your code. It gave me a really good spring-board for how this would work. Good news, it's working really well. I even got it adding a couple of tags too which is cool, so you know where the request came from.

This is the code that powers it:
public function boot(SaloonRequest $request): void
{
    $this->addResponseInterceptor(function (SaloonRequest $request, SaloonResponse $response) {
        $telescope = app()->make(Telescope::class);

        $responseIsJson = Str::of($response->header('Content-Type'))->lower()->contains('application/json');

        $url = $request->getFullRequestUrl();
        $glue = str_contains($url, '?') ? '&' : '?';
        $query = http_build_query($request->getQuery());

        $fullUrl = $url . $glue . $query;

        $telescope->recordClientRequest(
            IncomingEntry::make([
                'method' => $request->getMethod(),
                'uri' => $fullUrl,
                'headers' => $request->getHeaders(),
                'payload' => $request->getData(),
                'response_status' => $response->status(),
                'response_headers' => $response->headers(),
                'response' => $responseIsJson ? $response->json() : $response->body(),
                'saloon_request' => get_class($request),
                'saloon_connector' => get_class($request->getConnector()),
            ])
        );

        return $response;
    });
}

What I'm thinking of doing is actually introduce two events that get thrown by Saloon when using the package called SentSaloonRequest and RecievedSaloonResponse, and then this telescope logic could be all written inside of a listener?
That way people using Telescope can choose to enable this functionality. Or would you prefer it was enabled by default?

Hey, @Sammyjo20 glad that code helps you. I think yes for this package better introduce two new events and enable them by default, but with the possibility to disable them.

Hey @rrolla I've implemented this in #24 check it out and let me know if you need anything else!

@Sammyjo20 Thanks for looking into this!
This is one of the obstacles I found in our situation, when migrating from Laravel's own HTTP Client.
I intended to post this a while ago as well, but forgot about it.
Since we're dealing with Client Requests, you could possibly check if it's enabled, using the value from the config.
Should be something along the lines of
$enabled = config('telescope.watchers.' . ClientRequestWatcher::class, false);

Telescope itself registers the watchers, only if they are enabled, here.
Another thing to keep in mind: Telescope's own ClientRequestWatcher masks values according to your specified properties in Telescope (ideally, sensitive information like passwords (by default)).
If you could instead use Laravel's builtin Events, that Telescope listens on, all of this would happen automagically without the need for an interceptor, or so.
The downside, of course, being that it won't add which SaloonRequest was sent, or the SaloonConnector used.
But I guess, for that, you could possibly look into register some context callback, and Telescope will add that context for you.
I recall seeing that somewhere and can quickly look it up, if it's of interest.

Yes I would be interested in that! I looked at the watcher code, but not in depth admittedly. I didn’t think I could use it to capture HTTP events.

Just looked at the docs, I could definitely make a custom watcher.

What I had in mind was more towards registering a callback, to add context/content to the IncomingEntry.
This looks like the best option, as it's also before it's saved to database (which is another callback).
However, I'm not entirely sure how to handle it correctly, when checking if it's an IncomingEntry we care for.
So, in that case, you're probably more on the right track with a custom watcher, than registering the callback I suggested.
I think you should be able to extend the ClientRequestWatcher at large, just register different events (the ones you've added), and then just copy the current record*() methods (for the parameter masking etc), and just add the context you want to add to it.
It does, however, look like you'll still need to somehow inject your watcher in the Telescope config.
So, maybe, to also not override if users has added your watcher explicitly, is to first check the existence of your watcher, or, add it with the same enablement as Telescopes ClientRequestWatcher (by default).
Not sure if I overcomplicate things.
if (! config('telescope.watchers.' . SaloonRequestWatcher::class)) {
    // Update the default value from true, if needed.
    $enabled = config('telescope.watchers.' . ClientRequestWatcher, true);

    config(['telescope.watchers.' . SaloonRequestWatcher::class => $enabled]);
}

This will be coming with the Laravel HTTP client sender in v2


Improve solution of vector problems

Improve Equation.solve():

In addition to cg (conjugate gradient = CG) solver, allow pcg (pre-conditioned CG) and bicg (bi-CG);
Fix bug when 'info = True' argument is passed to function;
Correctly apply non-homogeneous Dirichlet boundary conditions to vector quantities.

Further improvements:

Fix bug in BlockMatrix.tosparse() when scipy.sparse.bmat() computes wrong shape because of too many empty blocks;
Extend 2D Stokes unit tests (add non-homogeneous test, verify results with Scipy).

ca we add scipy into the  solve method and do array_to_stencil internally

ca we add scipy into the solve method and do array_to_stencil internally
I am not sure this is a good idea. One interest of the numpy/scipy conversion is to allow a user to rely on general scipy libraries, which greatly improves the prototyping capabilities of Psydac. These conversions should be visible in these tests/examples, not hidden inside the psydac solvers.

I think the only remaining point was to quote references for the tested problems, when available. Since this does not seem to be the case, the PR is ok for me.

ca we add scipy into the solve method and do array_to_stencil internally

I don't think this is a good idea. One interest of the numpy/scipy conversion is to allow a user to rely on general scipy libraries, which greatly improves the prototyping capabilities of Psydac. These conversions should be visible in these tests/examples, not hidden inside the psydac solvers.

we can have both, this is just a way to present it nicely


cudpp_segmented_scan_cta.cu "Removed dead synchronization intrinsic" advisories

What steps will reproduce the problem?
1. Build cudpp release or debug

What is the expected output? What do you see instead?

Expect no errors or warnings or advisories.  Instead get lots of these:

jS4_PjS9_
src/cta/segmented_scan_cta.cu(868): Advisory: Removed dead synchronization
intrinsic from function
_Z14segmentedScan4If19SegmentedScanTraitsIfL13CUDPPOperator2ELb0ELb0ELb0ELb0ELb1
ELb0EEEvPT_PKS3_PKjjS4_PjS9_

Suggested fix:
I realize that removing this __syncthreads() causes failure.  I believe
though that the compiler is only removing it from some calls to the
function that includes it, not all.  So instead of putting the
syncthreads() inside this function, put it right before the call to the
function, only where it is needed.

Please use labels and text to provide additional information.

Original issue reported on code.google.com by<EMAIL_ADDRESS>on 17 Jun 2009 at 1:38

What do you know - CUDA 2.2 seems to have fixed this bug - so I will comment
the offending syncthreads for
now (only tested on linux though - I will test on windows as well)

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 5:18

FIne, I'll fix it.  I explained how to fix it in the description, I'll try it
myself.  But we aren't marking this "wont fix".

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 9:38

Changed state: Started

Reverted since behavior much more stable with the syncthreads

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 7:00

Changed state: WontFix

Verified on Linux with CUDA 2.2

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 5:22

Changed state: Fixed

Verified on Windows XP with CUDA 2.2

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 3:21

Original comment by<EMAIL_ADDRESS>on 26 Jun 2009 at 8:04

Changed state: Verified

I fixed this for CUDA 2.2.

Original comment by<EMAIL_ADDRESS>on 30 Jun 2009 at 5:07

This advisory is fixed in CUDA 2.3.  There is a bug in the compiler where
moving the
__syncthreads() from the beginning of warpSegScan() to right before each call
of it
causes the code to fail.  I filed an NVIDIA bug for this.

Closing this for now.

Original comment by<EMAIL_ADDRESS>on 26 Jun 2009 at 8:03

Changed state: WontFix

I tried your approach and it didn't work (that is putting the syncthreads
before calls to warpSegScan)

Original comment by<EMAIL_ADDRESS>on 25 Jun 2009 at 9:41


Is it support Deepgreen?

Checked that Greenplum has been supported, but what about Deep Green? Thanks

Any chance you can try and tell us?

is Deep Green a Postgres derivative like green plum?

Notice: this issue has been closed because it has been inactive for 437 days. Feel free to comment and request for this issue to be reopened.

How to connect to greenplum, not able to figure out ?


Page constantly refreshes during build

If a build is still in progress and I visit the status page, my browser continually refreshes every second until the build is done.

@bradrydzewski I think Rancher had this same issue and resolved it by implementing support for ProxyProtocol which ELB supports - Is this any option for Drone?
http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/enable-proxy-protocol.html

0.4 branch uses server sent events which is uses pure http and does not require a protocol upgrade like websockets. It will need to be tested, however, this may solve the issue with ELB.

hmmmm....I'm running the drone/drone:latest build from yesterday (9/13) and I was not getting streamed events in the web view when doing a build behind an AWS elb.
I see there is a 0.4 branch, should I be building that and using it instead?

0.4 is not stable, however, it isn't far from being released either. I wouldn't recommend using it quite yet, but since release is not far off we aren't making major changes to the stable channel


Created the azure side of project :fireworks:

added our own hub and storage details :+1:

merged the newest one


No support for GRBL on Arduino Nano?

I have a china clone of an Arduino Nano with CH3xx but I'm not able to connect to it.

Odd, are you sure that no other program has the connection open?

Delete App.config and try again, same issue?

This question could be a clue? It seems that I do not have any CH340 based boards to test with so I am kind of stuck when it comes to debugging this. My Mega and Due are both genuine boards with Atmel USB<>UART chips and they work fine, and the CP210x based ESP32 board does as well.

Hmm, looks like that could be a clue. But wired that it works with other programs fine... only ioSender does not work currently.


Zoom out

Croppie always seems to open with the zoom set to the minimum with 'bind'.  Is it possible to zoom out and hence make the image smaller?

I use a workaround for this which was to set the initial zoom to 1 with JQuery after croppie is bound. It's not perfect, but it works....


[Accessibility]A11y_VSCode_VSCReadyToInstall_Screenreader: NVDA is not reading the "Back","Next" and "Cancel" buttons as buttons.

Environment Details:
VSCode Version : 1.24.0
OS Version: Win10
OS Version : HighSierra10.13.5
Additional Details:
ScreenReader: NVDA
NVDA Version: NVDA2018.2
Repro Steps:
1)Launch VS Code while NVDA is ON.
2)Launch Visual Studio code desktop application.
3)Click on next button-->Next-->Next-->Next -->NextButton
3)With the help of Tab just observe the NVDA Readings.
Actual:
NVDA is not reading the "Next" and "Cancel" as buttons.
Expected:
NVDA should read the appropriate role for all the controls on the screen.
Recommendations:
Refer below link which is repository of bug fixes code snippets:
https://microsoft.sharepoint.com/teams/msenable/mas/pages/browse-fixes.aspx
User Impact:
User will not come to know that there are buttons present on the screen.
Attachment for Reference:
[Accessibility]A11y_VSCode_VSCReadyToInstall_Screenreader.pptx
Does this issue occur when all extensions are disabled?: Yes

This just seems like a duplicate of #52476

This issue not reproducing in new version VScode 1.24.1.


miner: reuse output from tortoise for multiple proposals

Motivation
it is completely redundant, and very noisy in logs if smesher creates many proposals.
Changes

reuse BaseBallot result
adjust expectations

bors merge

bors merge

bors merge

bors merge


Vim installation not working

Syntastic has been installed and is confirmed to be working by running :SyntasticInfo from inside Vim. That produces this:
Syntastic version: 3.6.0
Info for filetype: javascript
Global mode: active
Filetype javascript is active
The current file will be checked automatically
Available checkers: -
Currently enabled checkers: -
Press ENTER or type command to continue

Inside my .vimrc file, I have the following:
let g:syntastic_javascript_checkers=['standard']

And when I run a standard command, standard ./test.js, I get good output:
standard: Use JavaScript Standard Style (http://standardjs.com)
  /Users/matthewepler/test.js:2:24: Parsing error: Unterminated string constant

So if all the individual parts are working, why isn't standard showing up as the checker for Syntastic?
Forgive me if this is a Syntastic error, but because it seems to give good output with the :SyntasticInfo I assume the error is elsewhere.

Maybe Syntastic can't show errors if there is a serious error like a parse error? Can you try a simple error like a semicolon:
console.log('hi');

📢  Any Syntastic users able to lend a hand here?

 My bad. will close immediately and proceed to shame myself.

@matthewepler Glad you got it figured out. No shame needed.


Why there is 'batch-size' option in the model.evaluate()

Hi by looking at the example from keras.io 'Getting started at 30 second'
classes = model.predict_classes(X_test, batch_size=32)
proba = model.predict_proba(X_test, batch_size=32)
Why there is batch_size argument?
is it for validation set evaluation in the training process?

For the same reason it exists everywhere else: so the data (in this case, X_test) is fed into the model in batches of the given size. What exactly is unclear to you?

Probably similar to Seung, I was confused with a requirement of batch_size
in the prediction because the requirement is of no use in the batch type
machine learning methods such as MLR, SVM, GP but needed in the stochastic
gradient based machine learning methods such as single layer ANN, shallow
NN and DNN.
In line with the question, is there any simple algorithm to guess the best
batch size? I am mainly wondering about it regarding computation speed at
the prediction moment where no performance variation is expected depending
on a batch size. The answer would be 10%, 20% or all of a test data. The
aim of the guess is to give a reasonable default value of the batch_size so
that general users do not need to consider about it when they try to
predict their new data from the trained model developed by an expert.
-James
On Mon, Jun 20, 2016 at 12:54 PM Marcel Bollmann<EMAIL_ADDRESS>wrote:

For the same reason it exists everywhere else: so the data (in this case,
X_test) is fed into the model in batches of the given size. What exactly
is unclear to you?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/fchollet/keras/issues/3027#issuecomment-227201563,
or mute the thread
https://github.com/notifications/unsubscribe/ACchnSUC1ErqTf0xWRUhHacC9BsUykg0ks5qNsW-gaJpZM4I5ipm
.

--
Sungjin (James) Kim, PhD
Postdoc, CCB in Harvard
<EMAIL_ADDRESS>[Web] http://aspuru.chem.harvard.edu/james-sungjin-kim/
[Linkedin] https://www.linkedin.com/in/jamessungjinkim
[Facebook] https://www.facebook.com/jamessungjin.kim
[alternative email]<EMAIL_ADDRESS>

when testing normal dense MLP or deep conv nets, there is no need for batch_size doesn't it?
so the model generates softmax probability of images in deep conv nets.
Argument batch_size first gave me impression that testing only goes within the batch
so it wouldn't work if there is less data number than the batch_size.
but as far as I know classifier is just matrix multiplication and must be capable of calculate
inputs regardless of data number that is fed to it.
I'm new to keras and other DL packages like MatConvNet didn't require
something like batch_size in the testing time.
I know it is needed in the training time for the SGD batch learning.
But I just want to know why we have to explicitly feed batch_size argument to the evaluate function.
does change of 'batch_size' argument affect evaluate function?

For example, Here is what i thought what it should be
""
Trained_model = SomeTrainingProcess()
Y = Trained_model(X)
""
(Dimension : X=(None,784) , Y= (None,10)))
So that Trained_model can predict any number of 784 vector instances.
But Keras requires 'batch_size' field. In the doc it says for evaluate function
evaluate(self, x, y, batch_size=32, verbose=1, sample_weight=None)
batch_size: integer. Number of samples per gradient update.
which doesn't make sense because evaluate function doesn't involve any gradient update.

Okay, I can see now where your confusion is coming from...
For one, some models in Keras require a fixed batch size even during prediction/evaluation. This is true for stateful RNNs, for example, since they keep information from one batch to the next. According to the docs it's also the case for RNNs with Dropout when using the Tensorflow backend, presumably for technical reasons in the implementation.
If this doesn't apply to your model, it's true that setting a batch_size isn't technically needed. I believe it can affect the runtime performance of your model though, since it's basically controlling how much data is fed to your GPU at a time (= in one batch).

Have a look at this if you're not convinced http://philipperemy.github.io/keras-stateful-lstm/

The batch size is both important for training results (it has a strong effect on the network's training memorization(overfitting)/generalization ratio) and on the networks optimized code generated before the training starts (the large amount of time it takes to call fit for the first time), for instance statefulness operates across batches (this same optimized code must then be used for testing, I think using a different batch size will cause an exception though I'm not sure if I ever checked this). So there you go, in any case, you wouldn't want your model to use different configuration in test and train, it might effect the results in a very unpredictable manner.

I was also confused by the batch_size here. But more by the fact that the default value (32) was making my model evaluate very slowly. I might be wrong, but, at least for ffnn on GPU, for the evaluation purposes, the larger the batch_size the better, so I expected it to default to the size of the whole data set. At least, an option batch_size=None, could be handy.

@veltzerdoron I use different batch sizes for training and testing all the time, and since I don't use stateful models, the results are predictably the same no matter what the batch size during testing is.
@wjaskowski I think that depends on the size of your model and your data. The GPU memory has to be large enough to process the full batch at the same time, so defaulting to the size of the dataset might actually just crash when working with very large datasets.

@wjaskowski @mbollmann I don't know whether the GPU would ultimately crash but a larger batch size is not always better. I recently ran some image classification performance tests to measure throughput (images/sec) vs. batch size. Starting with a batch size of one, increasing the batch size increased image throughput until a batch size of about 32, at which point throughput suddenly dropped by ~25%. Throughput then increased with increasing batch size until a batch size of 64, at which point it dropped again, then increased (though in a much less monotonic manner). Same situation again at batch size of 96. I'm just guessing here but it seems that there was some buffering being done and data was being moved in chunks of 32 images.
The basic take-away for my model/GPU combination was to use a batch size of 32 images, which provided the greatest throughput and relatively low variability.

with a none RNN model, to run evaluate with different batch_size may get different results.
how to get the simplest mean loss value?

This is definitely something that confused me as well.


MapBoxEvent.banner_instruction

hello ecopeter, any update about some event is not triggered. and Inside RouteProgress getting always null value. plz answer about mentions issues. this issues occurs in both android as well as IOS.

please give any update about this Issues.

Stale issue message


Create System to Hook into Flutter CLI commands

Use case

If you want to create a web app that uses Rust WASM Bindgen, you could have the WASM build whenever the app starts, and whenever there is a hot reload and there are changes in the Rust code directory
If you are using C++ code in an App, you can have it regenerate whenever the app is being built for production.
If you are using Codegen frameworks like MobX, you could have it automatically update the generated files on a run, build, or reload with their base-files changed. This is better than having them generate every time a file changes because they can be only generated when they are needed.
Run Flutter Format and Flutter Test when publishing to pub.dev

Proposal
I believe a structure similar to Github Actions would work extremely well for this. A .flutter/scripts/ folder could contain individual yaml files for different actions.
an example of this could be
./flutter/scripts/build-rust.yaml
on:
    run:
    reload:
           # IF THIS DIRECTORY HAS CHANGES
            - rust/

commands:
       run: rustc rust/main.rs
       run: cp rust/main assets/wasm

tangentially related to https://github.com/dart-lang/sdk/issues/32894

I don't believe so. That feature request is for additions to the
internal dart compiler rather than hooking external scripts into it.
On Sat, Mar 6, 2021 at 12:18 PM Francesco Iapicca<EMAIL_ADDRESS>wrote:

tangentially related to dart-lang/sdk#32894
https://github.com/dart-lang/sdk/issues/32894
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/flutter/flutter/issues/77431#issuecomment-792047623,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJEI4PW6X5XHELRMSRMNZ7LTCKEZNANCNFSM4YWC6SAA
.

--
https://www.linkedin.com/in/benswerdlow/

@jonahwilliams If I write a proposal could I work on this?

@theswerd this is a really non-trivial addition, it would likely require a significant amount of research into how the tool currently works, and a well researched proposal. I don't want to discourage you: I would certainly be available to discuss the design, but I won't be able to do the heavy lifting.

@jonahwilliams before I start I have a few questions:

Would you prefer it if the hooks came in the pubspec.yaml, or in another file?
1b. Would you prefer each hook be an individual file or all routed through a single one?
Would you prefer the commands that run on a hook call written in YAML, dart, scripts, or something else?
Would you prefer a hook trigger give information about the event or just what the event was. For example on hot reload would it send a list of the files changed or just register that a hot reload occurred?

@theswerd I'm not even certain this feature is a good idea. The most important thing you can work is providing a really solid case that this is a positive enhancement to the tool, and could be done in a simpler way

@jonahwilliams here is why I wanted it:

This idea came from my annoyance at having to run the MobX CodeGen command so much. Keeping these files up to date can be extremely time-consuming, and if they are out of date, you can not notice for a while, and they could get in your way. If you make an update while Flutter is running, you are stuck opening a separate terminal window, re-finding the codegen command, and re-running it. While one solution could be tying the codegen to file changes, this is highly unoptimized. I save my files many times in between hot reloads - I don’t need to regenerate prototypes every time. This solution would also allow projects to remove generated files from their source control, as they could be generated at compile time.
As Flutter web gains a bigger presence, WASM tooling will become more important. Being able to update WASM with Hot Reload would be an amazing feature. This could also be useful with building native extensions.
When publishing a Flutter package, I would like to force Flutter to check my code formatting, and run my tests when I run the publish command.

This idea came from my annoyance at having to run the MobX CodeGen command so much

What does MobX use for code gen? If it is using build_runner, isn't there a watch command that could be used?

WASM tooling will become more important.

I'm less certain of this. Certainly WASM usage will increase, but will Flutter developers end up mostly consuming this via plugins?

When publishing a Flutter package,

This is tricky, publishing can be done via flutter pub publish or dart pub publish, in the latter case we don't get a chance to run so neither would any hooks. This might be better brought up as a feature request for pub

3. When publishing a Flutter package, I would like to force Flutter to check my code formatting, and run my tests when I run the publish command.

@theswerd
you can do this with github actions

@jonahwilliams there is a listener command, however, I would still like to make sure it rebuilds then whenever I run flutter build so I can be sure they are up to date.
@iapicca you can, however for people who want to push from their computer, or for other commands like flutter analyze it could be nice to have it automatically run format.

Instead of adding to the flutter tool, you could instead do something like:
dart run some_codegen_script && flutter build

And then stick that in a script. Compared to extending the flutter tool, that is tremendously simple

How about a hook to do work after building but before running? I'm thinking of plugging in native libraries, which currently are very tedious to add. You need to configure 5 different build systems for a cross platform app. Would be much easier to repackage the APK for example. If you're the developer of a rust library for flutter applications you really don't want to add long tutorials of xcode screenshots to properly configure the build.


Fix: Close datepicker on touchstart

It seems that when the event system was reworked, the bug closed in https://github.com/eternicode/bootstrap-datepicker/pull/223 got reintroduced. This PR fixes this.

Can you add tests to avoid regressions like this in the future? Thanks!

I've never done this for JS so I hope it's OK like this. Let me know.

Looks good to me! @vsn4ik @Azaret do you guys have any comments on this?

LGTM!

Thanks @clemens!

Hmm I've just merged but this pr came to my attention #1284, are we also introducing the same bug again @clemens?

That's quite likely. However: Mousedown wasn't triggered for me despite not scrolling – hence the PR.
I'll double check and get back to you.

That's great! Or if you have/find another workaround to support both cases would be nice!

I've done a little investigation and it looks like there's no easy way to get both things working properly. The best idea I have (inspired by things I think I remember from other libs) would be as follows:

capture the origin of a touchstart event
trigger the closing action on mouseup and touchend instead of mousedown and touchstart (the mouseup change is merely for consistency because it's the equivalent of touchend)
cancel the touchend handling if the distance between the origin captured in touchstart and the destination in touchend is below a certain (user-editable) threshold (i.e. it counts as a click rather than a scroll below that threshold)

I'm afraid my JS skills probably don't suffice for a decent implementation of that solution.
For the time being, I'd argue that being able to close the datepicker by touching outside of it is more important than the datepicker staying open when the user scrolls – but maybe that's just my point of view. I'd understand if you want to revert my PR.
Cheers,

C.


Fix(curriculum): Incorrect link in Build A Tribute Page project

Checklist:

[x] I have read and followed the contribution guidelines.
[x] I have read and followed the how to open a pull request guide.
[x] My pull request targets the main branch of freeCodeCamp.
[ ] I have tested these changes either locally on my machine, or GitPod.

Closes #52750

Hey @Snp-Rj-Ind-code-error-420
Thank you for opening this pull request and being eager to contribute.
Related issue is limited to first-time contributors to this repository, because of that I'm going to close this PR.
Thank you and happy coding.


Remove config key order check

Removes the top-level config key order check introduced in #710.
The check introduced in the above PR adds restrictions that prevent valid advanced use cases:
bases:
  - baseline-config.yaml
---
environment:
  values:
    - myValues.yaml
---
bases:
  - {{ .Values.someEnvironmentVal }}-defaults.yaml.gotmpl
---
releases: ...

In both v1 and v0 mode, this is valid structure that will template correctly without this policy. I can understand the intent for the rule to help weed out cases where someone tries to use an environment variable before it's defined, but it shouldn't prevent users who understand the ordering rules from fully leveraging helmfile's layering capabilities.
Resolves #1471

@drivelikebrazil thanks so much.


Dev app server command line argument validation

There is a minimal validation implemented by #93, however we could provide more useful validation to the users for e.g.:

path values
log level (or in general for enum) values
numbers, port numbers
hostnames

obsolete. This is now part of app-tools-lib-for-java


0.2.3-0

Pull Request Test Coverage Report for Build 69

1 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-1.4%) to 90.164%

Files with Coverage Reduction
New Missed Lines
%

src/writeClassFile.ts
1
88.89%

Totals

Change from base Build 64:
-1.4%

Covered Lines:
143

Relevant Lines:
150

💛  - Coveralls


Linode provider duplicates "*" subdomain record

Describe the bug
When using the Linode provider with a subdomain named "*",  duplicate DNS records are created.
The frequency of this issue
This issue is easy to reproduce.
Your GoDNS configuration
{
  "provider": "Linode",
  "login_token": "<redacted>",
  "domains": [
    {
      "domain_name": "godns.test",
      "sub_domains": ["@", "*", "minecraft"]
    }
  ],
  "ip_url": "https://icanhazip.com/",
  "ip_type": "IPv4",
  "interval": 5,
  "resolver": "<IP_ADDRESS>",
  "debug_info": true,
}

Expected behavior
Only one DNS record should be created for the "*" subdomain.
Screenshots

Additional context
I've already know the source of the problem and wanted to make this issue to track it. It is due to a bug in the Linode API that makes it unable to find a subdomain when it's named "*". I've contacted Linode support and opened a ticket, but it may be a while.

@drewgingerich any progress being made? I'm seeing your same issue on my domain.

@c4lliope a PR has been merged with a workaround for this issue, so you should stop seeing duplicate wildcard subdomain records in the next release 👍

I pulled and remade my binary, glad you could make an easy repair.

Linode closed the ticket I had open regarding this bug. They essentially said that while they are tracking it, it's not a high enough priority to change in the near future. We have a functional workaround in place, so I'm closing this issue.


Problem with Postgres and creating a new menu item

Hi guys,
currently i'm playing a bit with the backpack.
It seems that everything works so far.
But i have the problem, that I can't create a new menu item.
I got always the following error message:
ErrorException in CrudTrait.php line 32:
Undefined offset: 0

Which is the following:
$answer = DB::select(DB::raw("SELECT IS_NULLABLE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='".$instance->getTable()."' AND COLUMN_NAME='".$column_name."' AND table_schema='".env('DB_DATABASE')."'"))[0];

I have changed the statement to the following:
$answer = DB::select(DB::raw("SELECT IS_NULLABLE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='".$instance->getTable()."' AND COLUMN_NAME='".$column_name."'"))[0];

then I got the following error message:
ErrorException in CrudTrait.php line 38:
Undefined property: stdClass::$IS_NULLABLE

Which is:
        return $answer->IS_NULLABLE === 'YES';

If I change it to:
        return $answer->is_nullable === 'YES';

then I'm able to create and update the menu item.
My Environment and setup is the following:

Host Maschine: OSX
Docker Container via LaraDock with nginx and postgres

I have installed also nWidart/laravel-modules to keep my app directory as clean as possible
The created module includes the sources from the MenuCRUD example with the needed customizations (namespace etc.)
composer.json:
{
    "name": "laravel/laravel",
    "description": "The Laravel Framework.",
    "keywords": ["framework", "laravel"],
    "license": "MIT",
    "type": "project",
    "require": {
        "php": ">=5.6.4",
        "laravel/framework": "5.3.*",
        "backpack/base": "^0.7.1",
        "backpack/crud": "^3.1",
        "backpack/generators": "^1.1",
        "backpack/langfilemanager": "^1.0",
        "backpack/backupmanager": "^1.1",
        "backpack/logmanager": "^2.3",
        "backpack/settings": "^2.0",
        "backpack/permissionmanager": "^2.1",
        "barryvdh/laravel-debugbar": "^2.2",
        "nwidart/laravel-modules": "^1.13"
    },
    "require-dev": {
        "fzaninotto/faker": "~1.4",
        "mockery/mockery": "0.9.*",
        "phpunit/phpunit": "~5.0",
        "symfony/css-selector": "3.1.*",
        "symfony/dom-crawler": "3.1.*"
    },
    "autoload": {
        "classmap": [
            "database"
        ],
        "psr-4": {
            "App\\": "app/",
            "Modules\\": "Modules/"
        }
    },
    "autoload-dev": {
        "classmap": [
            "tests/TestCase.php"
        ]
    },
    "scripts": {
        "post-root-package-install": [
            "php -r \"file_exists('.env') || copy('.env.example', '.env');\""
        ],
        "post-create-project-cmd": [
            "php artisan key:generate"
        ],
        "post-install-cmd": [
            "Illuminate\\Foundation\\ComposerScripts::postInstall",
            "php artisan optimize"
        ],
        "post-update-cmd": [
            "Illuminate\\Foundation\\ComposerScripts::postUpdate",
            "php artisan optimize"
        ]
    },
    "config": {
        "preferred-install": "dist"
    }
}

My Workaround is currently to duplicate the CrudTrait and using this in the models.

Workaround:
app\PostgresCrudTrait.php:
<?php

namespace App;

use DB;
use Illuminate\Database\Eloquent\Model;

trait PostgresCrudTrait
{

    public static function isColumnNullable($column_name)
    {
        $instance = new static(); // create an instance of the model to be able to get the table name

        // $answer = DB::select(DB::raw("SELECT IS_NULLABLE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='".$instance->getTable()."' AND COLUMN_NAME='".$column_name."' AND table_schema='".env('DB_DATABASE')."'"))[0];

        $answer = DB::select(DB::raw("SELECT IS_NULLABLE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='".$instance->getTable()."' AND COLUMN_NAME='".$column_name."'"))[0];

        return $answer->is_nullable === 'YES';
    }

}

Example Usage:
app\User.php
<?php

namespace App;

use Backpack\CRUD\CrudTrait;
use App\PostgresCrudTrait;
use Spatie\Permission\Traits\HasRoles;
use Illuminate\Notifications\Notifiable;
use Illuminate\Foundation\Auth\User as Authenticatable;
use Backpack\Base\app\Notifications\ResetPasswordNotification as ResetPasswordNotification;

class User extends Authenticatable
{
    use CrudTrait, PostgresCrudTrait {
        PostgresCrudTrait::isColumnNullable insteadof CrudTrait;
    }
    use HasRoles;
    use Notifiable;

    /**
     * The attributes that are mass assignable.
     *
     * @var array
     */
    protected $fillable = [
        'name', 'email', 'password',
    ];

    /**
     * The attributes that should be hidden for arrays.
     *
     * @var array
     */
    protected $hidden = [
        'password', 'remember_token',
    ];

    /**
   * Send the password reset notification.
   *
   * @param  string  $token
   * @return void
   */
    public function sendPasswordResetNotification($token)
    {
        $this->notify(new ResetPasswordNotification($token));
    }
}

@noxify Hi - My friend had a similar issue, he solved it by making sure the database schema for the fields were set to allow null and it worked, it may be worth giving that a go?

@OwenMelbz - thx. I will check the schema :)

Hmm... I think we can do something like this:
switch ($this->connection->driver)
 case 'postgresql':
   // smth;
 default:
   // smth else;

But we can't do it in CrudTrait::isColumnNullable(), because there is no $this, it's a trait.
And we can't do it as a parameter in the fields that need it, because $connection is protected...
Will think about it some more and come back to you...

@tabacitu You can use $this in traits. It's possible even to access private fields of class, where traits is used.
The problem stays because postgres by default has 'public' schema (global schema, public.table_name and table_name is the same), and there is no schema called DB_DATABASE.

Ok, found a solution (finally) and it's now fixed. We ended up using Doctrine for this, because (dooh) it knows how to do this for all database systems. It is now:
     public static function isColumnNullable($column_name)
      {
         // create an instance of the model to be able to get the table name
         $instance = new static();

         // register the enum column type, because Doctrine doesn't support it
         DB::connection()->getDoctrineSchemaManager()->getDatabasePlatform()->registerDoctrineTypeMapping('enum', 'string');

         return ! DB::connection()->getDoctrineColumn($instance->getTable(), $column_name)->getNotnull();
      }

PosgreSQL users, if you could run a composer update and confirm, that would be great.
Cheers!
P.S. I'll go ahead and close this issue so we don't clog the section. Feel free to open it again if you encounter problems or comment if you have follow-ups.


Thornspeaker training shows the wrong abilities

Fixed both Tidesage and Thornspeaker's upgrade tooltips, both now correctly reference the proper spells


Missing check for "unexpected continuation byte"

c.f. https://en.wikipedia.org/wiki/UTF-8#Invalid_byte_sequences

I decided to track this as part of #219


Thumbor URL filter "proportion" only works when "fit-in" is also in path

Describe the bug
The proportion filter does not work on its own. There is a requirement for "fit-in" to be in the path.
See: https://thumbor.readthedocs.io/en/latest/proportion.html
To Reproduce

Try using the proportion filter and see the 500 error: https://example.cloudfront.net/filters:proportion(0.8)/image.jpeg

Try using the proportion filter with "fit-in" and see it working: https://d32abwnbpp68aa.cloudfront.net/fit-in/500x500/filters:proportion(0.8)/media/image.jpeg

Expected behavior
The Thumbor documentation states it can be used on its own, so I would expect the same behaviour here.
The supported Thumbor AWS filters documentation does not state the requirement of "fit-in": https://docs.aws.amazon.com/solutions/latest/serverless-image-handler/thumbor-filters.html
Please complete the following information about the solution:

[x] Version: v6.0
[x] Region: all
[ ] Was the solution modified from the version published on this repository?: No
[ ] If the answer to the previous question was yes, are the changes available on GitHub?
[ ] Have you checked your service quotas for the sevices this solution uses?
[ ] Were there any errors in the CloudWatch Logs?: Yes

2022-02-25T10:55:22.443Z	47ead4d3-8b1a-4f45-b45a-9a3f754d11f3	ERROR	ImageHandlerError: The image request you provided could not be decoded. Please check that your request is base64 encoded properly and refer to the documentation for additional guidance.
    at ImageRequest.decodeRequest (/var/task/image-handler/image-request.js:293:23)
    at ImageRequest.parseRequestType (/var/task/image-handler/image-request.js:241:18)
    at ImageRequest.<anonymous> (/var/task/image-handler/image-request.js:33:53)
    at Generator.next (<anonymous>)
    at fulfilled (/var/task/image-handler/image-request.js:7:58) {
  status: 400,
  code: 'DecodeRequest::CannotDecodeRequest'
}

2022-02-25T10:55:22.552Z	47ead4d3-8b1a-4f45-b45a-9a3f754d11f3	ERROR	Error: Expected positive integer for width but received NaN of type number
    at Object.invalidParameterError (/var/task/node_modules/sharp/lib/is.js:110:10)
    at Sharp.resize (/var/task/node_modules/sharp/lib/resize.js:234:18)
    at ImageHandler.<anonymous> (/var/task/image-handler/image-handler.js:233:48)
    at Generator.next (<anonymous>)
    at /var/task/image-handler/image-handler.js:10:71
    at new Promise (<anonymous>)
    at __awaiter (/var/task/image-handler/image-handler.js:6:12)
    at ImageHandler.applyEdits (/var/task/image-handler/image-handler.js:85:16)
    at ImageHandler.<anonymous> (/var/task/image-handler/image-handler.js:46:50)
    at Generator.next (<anonymous>)

@Furytron thank you for your feedback. We will look into it and add it to our backlog. The current implementation requires resize parameter for the proportion filter in the URL, i.e. if you call https://d32abwnbpp68aa.cloudfront.net/500x500/filters:proportion(0.8)/media/image.jpeg it will work without fit-in.

keep open

We are adding this to our list to investigate and will comment with more information later.

@Furytron
This issue appears to have been resolved and no longer exists in the current version v6.2.3.
If this is still an issue please let us know.


Custom CSS

In atom you could edit the css of the editor, and that allowed for a lotta customizability.
What if we could get that same thing in VSCode? It would even make some of the requested features already available in the editor.

See https://github.com/microsoft/vscode/issues/168856#issuecomment-1346662409 why we don't want to go that way.
Closing as duplicate of https://github.com/microsoft/vscode/issues/459


Define prepare() in with_metaclass()

Define __prepare__() in with_metaclass()'s temporary
metaclass, and make sure that it passes the correct bases to the
real metaclass's __prepare__().
The temporary metaclass previously didn't extend the
__prepare__() method, which meant that if the real metaclass
had a __prepare__(), it wouldn't get called correctly. This
could lead to bugs in Python 3 code.
The temporary metaclass's __prepare__() gets called with
bases=(temporary_class,).  Since there was no proxy in the
middle, that was getting passed directly to the real metaclass's
__prepare__(). But then, if the real class's __prepare__()
method depended on the bases, the logic would be incorrect.
This was a problem in projects that use enum / enum34 and
try to use with_metaclass(EnumMeta). enum34.EnumMeta doesn't
define __prepare__(), since it is a Python 2 backport. Python
3's enum.EnumMeta does define __prepare__(), but originally
didn't depend at all on the bases. But starting in Python 3.6,
enum.EnumMeta.__prepare__() will raise TypeError if the
bases aren't valid for an enum subclass. Thus, a codebase that
was successfully using enum / enum34 and
with_metaclass(EnumMeta) could break on Python 3.6.

I think the __prepare__ method should only be included in Py3 selectively, not in Py2, to reduce the risk of incompatibilities. It has lead to user problems with Cython's own Py2/3 compatibility layer, for example:
https://github.com/cython/cython/issues/1936


'flutter run' for iOS14+ (real machine) in debug can not work

Use case
Click the application icon on the real machine to start the Android app in debug mode normally, and then perform the flutter attach operation for development
But in iOS14+ real machine,  cannot develop and debug in this way, an error page will be displayed.
This is an indispensable feature if you want to quickly develop flutter apps on the iOS side. We will run a flutter run for a long time, because ‘pod instal’l and ‘xcode build’.
So can we perfect the way.

Proposal
I use,
'ios-deploy -d xxx.app -a '--disable-service-auth-codes --observatory-port=8007 --enable-dart-profiling --enable-checked-mode''
then,
use 'flutter attach' for development.
So can we provide a feature to facilitate iOS14+ fast attach.

Without additional information, we are unfortunately not sure how to resolve this issue.
We are therefore reluctantly going to close this bug for now.
Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.
Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.


Remove argparse and adjust arguments in README

Fixes #10. Hydra has it's own built-in argparse to process the config path and arguments automatically.

Only one person needs to review! 🙇


Typeface

we couldn't set a typeface for number pinEntryEditText?

This feature was added, both fontFamily and setTypeface are now supported.
There is an example in the sample app on how to do this.


Feature/theme default page templates by pagetype

The getThemeDefaultBlockTemplates() Method in the Page Theme Controller allows for Theme developers to define specific Block templates that should be used by default with their theme.
However in many use cases this is not specific enough. We often would like to define a Default Block template per page type and end up defining it separatly for every Area instead, because there is no elegant way to do that on the Theme level.
With this PR this is now possible by returning something like this:
[  'full' => ['autonav'=>'breadcrumb.php'] , 'left_sidebar' => ['autonav'=>'navbar.php'] ]
istead of:
['autonav'=>'breadcrumb.php']
in the Page Theme getThemeDefaultBlockTemplates() Method

Following this post (https://www.concrete5.org/community/forums/customizing_c5/getthemedefaultblocktemplates-not-working-anymore/#928217), I had a look at this commit and I think there's a mistake.
Instead of
foreach($themeTemplates as $key => $template){
    $pt = ($this->getPageTemplateHandle()) ? $this->getPageTemplateHandle() : 'default';
    if(is_array($template) && $key == $pt){
        $pageTypeTemplates = $template;
    }
    unset($themeTemplates[$key]);
}

The unset() should eb inside the if or else you're just removing all the block templates that ar not for a specific page template
foreach($themeTemplates as $key => $template){
    $pt = ($this->getPageTemplateHandle()) ? $this->getPageTemplateHandle() : 'default';
    if(is_array($template) && $key == $pt){
        $pageTypeTemplates = $template;
        unset($themeTemplates[$key]);
    }
}

This resolves #6615


null is not an object at basic example

Hi,
I'm a complete noob at building android application but I want to use react-native-get-sms-android to read sms only.
What I did :

react-native init myapp
cd myapp
 yarn add react-native-get-sms-android
Add all permissions in android/app/src/main/AndroidManifest.xml
Copy from here to myapp/App.js just to get a working example
Launch android virtual device (Nexus one API 28)
Once virtual device is ready : react-native run-android

The app gets correctly loaded into the virtual device. I allow ,through the popup, my app to read sms. And then the crash :
null is not an object (evaluating '_reactNativeGetSmsAndroid.default.list')
I have checked those two closed issues :

36 : I assume I have correctly copy pasted from example (hope it's a working example, though!)
12 : I assume I'm not using Expo. Am I correct ? If not, I may need an explaination.

Otherwise, I just can't get the basic example working. Where is my fault ?

you didn't link maybe? https://github.com/briankabiro/react-native-get-sms-android#mostly-automatic-installation

Oh my .. I thought I did!
Now, sending sms is OK. Reading them, I don't know, nothing is displayed but I will dig in. I think it works.
Thank you mikehardy.

It is so easy to forget, and such a frequent source of issues that the entire CLI and linking process is being re-written for the v2.0 of the react-native CLI to implement "auto-linking". You're not alone ;-)


Fix #1587: Made intent/bundle/saved/tags instance keys consistent.

Explanation
"Fixes #1587:  Makes intent/bundle/saved/tags instance keys consistent.
Checklist

[x] The PR title starts with "Fix #bugnum: ", followed by a short, clear summary of the changes. (If this PR fixes part of an issue, prefix the title with "Fix part of #bugnum: ...".)
[x] The PR explanation includes the words "Fixes #bugnum: ..." (or "Fixes part of #bugnum" if the PR only partially fixes an issue).
[x] The PR follows the style guide.
[x] The PR does not contain any unnecessary auto-generated code from Android Studio.
[x] The PR is made from a branch that's not called "develop".
[x] The PR is made from a branch that is up-to-date with "develop".
[x] The PR's branch is based on "develop" and not on any other branch.
[x] The PR is assigned to an appropriate reviewer in both the Assignees and the Reviewers sections.

@rt4914, PTAL

@rt4914 PTAL

@janewaitara This PR has been created incorrectly.
By mistake you have created this PR on your personal fork and not on oppia/oppia-android .
To fix this please follow instructions mentioned in this link at each step:
https://github.com/oppia/oppia-android/wiki#instructions-for-making-a-code-change


Placing ME Conduit in facade with power conduit causing crash and unenterable world

I have seemed to have run into an error where I attempted placing a me conduit inside a facade with a power conduit already inside the facade.  The facade was painted with the futuristic armor from chisel 2.  I am currently unable to get back into the world.
Using Ender io: <IP_ADDRESS>9
Forge: <IP_ADDRESS>0
Here is the crash log
Crashlog: http://pastebin.com/MERa9KGa

AE rv1 is no longer supported

Never thought about updating AE2.  All seems to be working now


Extensible Kafka Auth Config

Current kafka sink does not support authentication which makes it difficult to adopt or use in many situations. This PR allows the kafka sink to behave as it is but to have an auth block added to easily cater to most if not all the supported authentications schemas of the python kafka package.
Its been tested with Apache Kafka and AWS MSK, confluent kafka untested.
  sinksConfig:
  - kafka_sink:
      name: kafka_sink
      kafka_url: "localhost:9096"
      topic: "robusta-playbooks"
      auth:
          sasl_mechanism: SCRAM-SHA-512
          security_protocol: SASL_SSL
          sasl_plain_username: robusta
          sasl_plain_password: password

additionally updated skaffold configs to the latest version, i can easily roll this back if its not wanted or needed.

Found an issue with my implementation where you couldnt use the {{ .env.SOME_SECRET }} env substitution because the dict wasnt being validated. I have two solutions here, the one ive included in the latest commit extends replace_env_vars_values to be able to recursively search any dictionaries too.
elif isinstance(value, dict):
    env_var_value = replace_env_vars_values(value)
    if env_var_value:
        values[key] = env_var_value

but this change in the root validator might be more encompassing than the maintainers want, Option B would be to extend just the kafka_sink_params to do a recursive search.
     Possible Option B.
     @validator("auth", pre=True, always=True)
     def auth_env_values_validation(cls, value: Dict):
         updated = replace_env_vars_values(value)
         return updated

@LeaveMyYard let me know what you think when you have time.


On Windows 8 and up, screen Fini function waits for the user to hit a key

See upstream issue https://github.com/rprichard/winpty/issues/119.
The test case doesn't really do much:
package main

import (
	"fmt"
	"os"

	"github.com/gdamore/tcell"
)

func main() {
	s, e := tcell.NewScreen()
	if e != nil {
		fmt.Fprintf(os.Stderr, "%v\n", e)
		os.Exit(1)
	}
	if e = s.Init(); e != nil {
		fmt.Fprintf(os.Stderr, "%v\n", e)
		os.Exit(1)
	}
	s.Clear()
	s.Fini()
	fmt.Printf("hello.go is about to exit...\n")
}

On Windows 7, the program runs and immediately exits, displaying the hello.go is about to exit... message as it exits.  On Windows 8, I must press a key to get it to exit.  (More generally, I have to do something that produces console input -- right-clicking the title works, as does resizing the console window or changing window focus to/from the console.)
There is a race condition involving the cScreen.scanInput goroutine:
func (s *cScreen) scanInput() {
    for {
        if e := s.getConsoleInput(); e != nil {
            return
        }
    }
}

tcell's Fini function closes the CONIN$ handle that scanInput / ReadConsoleInputW is reading from another thread.  It seems a little iffy to me, because some other thread could open an unrelated handle with the same value as the closed handle, and scanInput would pass that handle to ReadConsoleInputW.
The Windows behavior changed from Windows 7 to Windows 8.  In Windows 7, closing a console input handle interrupts an ongoing ReadConsoleInputW call, but in Windows 8, CloseHandle blocks until the operation has completed.
I wrote a C++ test program demonstrating the Windows API change:
#include <windows.h>
#include <assert.h>
#include <stdio.h>

#include <string>
#include <thread>

static HANDLE openConin() {
    const HANDLE ret = CreateFileW(L"CONIN$",
                GENERIC_READ | GENERIC_WRITE,
                FILE_SHARE_READ | FILE_SHARE_WRITE,
                nullptr,
                OPEN_EXISTING, 0, NULL);
    assert(ret != INVALID_HANDLE_VALUE);
    return ret;
}

static std::string timeStamp() {
    static const DWORD start = GetTickCount();
    const DWORD elapsed = GetTickCount() - start;
    char buf[128];
    sprintf(buf, "%03d.%03d", elapsed / 1000, elapsed % 1000);
    return buf;
}

int main() {
    const HANDLE h = openConin();

    auto t = std::thread([=]() {
        INPUT_RECORD ir {};
        DWORD actual {};
        BOOL success {};
        do {
            printf("[%s] worker: calling ReadConsoleInputW...\n",
                timeStamp().c_str());
            success = ReadConsoleInputW(h, &ir, 1, &actual);
            printf("[%s] worker: calling ReadConsoleInputW: returned %d, actual=%ld (error=%ld)\n",
                timeStamp().c_str(), success, actual, GetLastError());
        } while (success);
    });
    t.detach();

    Sleep(500);

    printf("[%s] main: closing CONIN$\n", timeStamp().c_str());
    CloseHandle(h);
    printf("[%s] main: closed CONIN$ -- pausing a bit...\n", timeStamp().c_str());
    Sleep(300);
    printf("[%s] main: closed CONIN$ -- exiting...\n", timeStamp().c_str());
    return 0;
}

Windows 7:
C:\Users\rprichard>\\nas\nas\test.exe
[000.000] worker: calling ReadConsoleInputW...
[000.500] main: closing CONIN$
[000.500] worker: calling ReadConsoleInputW: returned 1, actual=1 (error=0)
[000.500] worker: calling ReadConsoleInputW...
[000.500] main: closed CONIN$ -- pausing a bit...
[000.500] worker: calling ReadConsoleInputW: returned 0, actual=0 (error=6)
[000.813] main: closed CONIN$ -- exiting...

Windows 8 (also Windows 10):
C:\Users\rprichard>\\nas\nas\test.exe
[000.000] worker: calling ReadConsoleInputW...
[000.531] main: closing CONIN$
... wait a few seconds, then hit Enter ...
[006.406] worker: calling ReadConsoleInputW: returned 1, actual=1 (error=0)
[006.406] main: closed CONIN$ -- pausing a bit...
[006.406] worker: calling ReadConsoleInputW...
[006.406] worker: calling ReadConsoleInputW: returned 0, actual=0 (error=6)
[006.718] main: closed CONIN$ -- exiting...

The upstream winpty issues involves fzf.  fzf displays a prompt, and pressing Enter or Esc exits the program.  The symptom is that pressing Enter clears the screen, and I have to press another key (any key) to get it to exit.  After scanInput handles the Enter keydown, there is a race between two threads:

fzf calling Fini to close the console input handle
scanInput processing the Enter keyup, then waiting for further input

When typing at an ordinary console, there is usually a delay between the Enter keydown/keyup events due to typing speed.  Therefore, thread 1 wins the race, and the program exits.  (However, I can still see fzf begin to exit when I depress Enter, then wait around either until I've released it or until key repetition kicks in.)
With typing with winpty (or if I copy-and-paste a newline), there is no delay between Enter keydown and keyup, so thread 2 wins the race.  Thread 1 calls CloseHandle and blocks, exactly as described in the above C++ test case.
I'm not sure what the fix is.  I thought of a few ideas:
A. Explicitly shut down scanInput when Fini is called:

In Fini, set a boolean kill flag, then call WriteConsoleInput to synthesize an input record, which will wake up the scanInput goroutine.  It's not reliable, because any other thread or process could be reading the console input.  (If they do, though, console input tends to break anyway.)

Assuming a console input handle is signaled IFF there are records to read, then scanInput could block using WaitForMultipleObjects on the console handle and an event.  Fini could clean up by signaling the event.  Even if it worked, though, which I doubt, ReadConsoleInput always blocks, and PeekConsoleInput doesn't remove what it reads.

Maybe calling TerminateThread on the ReadConsoleInput thread would work, but even if it did, I doubt it'd be reliable.  The advice from Raymond Chen (Old New Thing) is to never use TerminateThread ever.  It's especially dangerous-looking on Windows 7 and below, where console APIs turn into csrss/conhost (A)LPC calls using a shared memory buffer.  We'd only need it on Windows 8 and up, though, where console handles are real kernel handles.

B. Don't ever shut down scanInput:  Only open CONIN$ and run the scanInput goroutine once per program, not once per screen instance.
My guess is fix B is the best one.  Are there fixes I'm missing?
I wonder how other console programs deal with this issue.  I think most languages don't try to provide async/non-blocking Windows console I/O, but I thought I'd seen it somewhere once, maybe Java?

It looks like Cygwin implements non-blocking console input reads by waiting for the console input handle to be signaled, then using a combination of PeekConsoleInput / ReadConsoleInput (something like A.2 above).  It assumes that only the one Cygwin process will be reading from the console, which is fairly reasonable, because something is usually broken if two processes are competing to read input.  References to Cygwin code:

https://github.com/mirror/newlib-cygwin/blob/4d336756fa7f47aa0a79e98fb4dea5c3e1b35d31/winsup/cygwin/select.cc#L936.  In preparation for a select call, it's placing fhandler_console's io_handle HANDLE value into a select_record.

https://github.com/mirror/newlib-cygwin/blob/4d336756fa7f47aa0a79e98fb4dea5c3e1b35d31/winsup/cygwin/fhandler_console.cc#L825.
It looks like the io_handle is CONIN$

https://github.com/mirror/newlib-cygwin/blob/4d336756fa7f47aa0a79e98fb4dea5c3e1b35d31/winsup/cygwin/select.cc#L886.  Here, it's assuming that PeekConsoleInput followed by ReadConsoleInput won't block, which is true in practice, because normally there's only a single process controlling console input at one time.

https://github.com/mirror/newlib-cygwin/blob/4d336756fa7f47aa0a79e98fb4dea5c3e1b35d31/winsup/cygwin/fhandler_console.cc#L296.  Here's the implementation of Cygwin's read() API for consoles.  It uses cygwait to block, which uses WaitForMultipleObjects to wait for conin handle to be signaled.

node.js/libuv is interesting:

It has a "raw read" mode and a "line read" mode.

For raw mode, I see a call to GetNumberOfConsoleInputEvents assigning its result to records_left, then at most records_left records retrieved with ReadConsoleInputW. [src].

I think it detects new raw mode input with RegisterWaitForSingleObject.  [src].

For both raw and line modes, wakes up the read by writing a synthetic INPUT_RECORD.  The raw wakeup record is all zeroes [src], and the line reading wakeup is a Return keydown [src].  The Return keydown is echoed to the screen, and libuv tries to undo that echoing.  [src].

I now think A.2 is the best fix.  Fini would set an event to make scanInput wake up and shutdown.  scanInput would use WaitForMultipleObjects to wait on both the CONIN$ handle and the shutdown event, and it'd use GetNumberOfConsoleInputEvents / ReadConsoleInputW to actually read input.
I see that getConsoleInput doesn't block if the 10-element evch channel fills up.  It's easy to fill it up by copying-and-pasting more than 10 characters at once.  My first instinct is to have Fini block until scanInput has finished, which I think can't cause a deadlock, because getConsoleInput discards input once evch is full.


Update Localization learning page

Update the Localization learning page with better and up-to-date examples

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Matthew Jordan seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Fixed CLAassistant not recognizing me in a new PR: #3981


feat: use stream to select new items

Currently, a FortuneWidget's animation will not be triggered, when the same value is selected multiple times in a row. This is due to the implementation checking for inequality of a new value.
With this change, FortuneWidgets will be passed a Stream<int> instead of int for the selected property, which triggers the animation whenever the stream sends a new value.
Since this feature changes the public API, it will be shipped with the next major version update.

@kevlatus , kindly advise on the animation functionality
It's still not working even if using Stream


Preserve project working directory

Some build scripts rely on references into the working directory of the project being built, so the project directory should be the same inside and outside the docker container.

Thanks for the PR, @dflemstr. Could you elaborate on this:

Some build scripts rely on references into the working directory of the project being built

Surely those build scripts are using relative paths rather than absolute paths; otherwise, they wouldn't be portable across machines.

so the project directory should be the same inside and outside the docker container.

That it's already the case, right? Everything within the project directory gets mounted into the Docker container. The project can't refer to anything outside of it because it's not mounted. Changing on which directory the Cargo project will get mounted inside the docker cointainer won't change that.

@dflemstr: You may want to consider making a Cargo Workspace containing all of your code. Check out this documentation: https://doc.rust-lang.org/book/second-edition/ch14-03-cargo-workspaces.html
Once you have made a cargo workspace, you can make the following call from the root of the workspace:
cross build --manifest-path ./your_main_crate/Cargo.toml --target <CROSS TARGET>
I was able to use this to build my crate with local source dependencies.

The reason why this is needed is because I need to link some (C++) libraries that are built outside of the container. Sadly I can't do this with relative paths since the libraries are needed for a dependency far down the dependency path of my crate, and each dependency crate is built with its own manifest directory as the current working directory.

@dflemstr can you build those crates inside the container using a build.rs script ?

@gnzlbg the building of the particular C++ codebase takes about 30-50 minutes so I would prefer to not do it on every cargo build if possible :)

@dflemstr so your build script then depends on how the directories outside of your crate are set up ?

Closing this as there are existing alternative ways of doing this. If you are still keen on including it, you can open a new PR.


[Bug] start.sh script in apache-eventmesh-1.9.0/bin directory executing error in linux

Search before asking

[X] I had searched in the issues and found no similar issues.

Environment
Linux
EventMesh version
master
What happened
i download apache-eventmesh-1.9.0-bin.tar.gz to my cloud server, unzip the file, run the start.sh script in apache-eventmesh-1.9.0/bin directory, it show like this

Because for shell files compiled under windows, each line ends with\ n\ r, while each line under linux ends with\ n
How to reproduce
download apache-eventmesh-1.9.0-bin.tar.gz to your linux server, unzip the file, run the start.sh script
Debug logs
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[ ] I agree to follow this project's Code of Conduct *

After writing the shell script in windows, use an editor (such as NotePad++) to convert the shell document format to unix,i will fix

you can execute the :set ff=unix to solve this problem, for now the master branch code has solve this problem.

In 1.10.0, this problem still exists. It will be fixed in the next version.


Time spent on question shouldn't be reset to zero on refreshing a page.

The backend now sends the same question again on a page refresh while a candidate is taking the test. We shouldn't refresh the time spent in this case.

Fixed.


"Maximum call stack size exceeded" For Android Http

"Maximum call stack size exceeded" For Android Http, then debug js Remotely is right.
ios is right.
code:
this.http.get('https://en.wikipedia.org/w/api.php?format=json&action=query&generator=allpages&gaplimit=10')
.subscribe(data => {
this.resMassage = data.text();
});

Solved after migrating to Angular 4.x, see 40f8e097d79df0ae5641f4c111278b428f2909dc


Integration with Django-cron

Hey guys,
I wanted to share how I integrated Django-dbbackup with Django-cron (http://django-cron.readthedocs.io/en/latest/) :
class Backup(CronJobBase):
    RUN_AT_TIMES = ['6:00', '18:00']
    schedule = Schedule(run_at_times=RUN_AT_TIMES)
    code = 'my_app.Backup'

    def __init__(self):
        directory = settings.DBBACKUP_STORAGE_OPTIONS['location']
        if not os.path.exists(directory):
            os.makedirs(directory)

    def do(self):
        management.call_command('dbbackup')
        management.call_command('mediabackup')

On the init command, I create the folder for the backup if it doesn't exist.
I run my task twice a day, 6am and 6pm.
You can easily monitor if your backup went wrong from the admin panel.
Cheers !

Hello @dorianamouroux
Thank you very much for this contribution !
I included that here: https://github.com/ZuluPro/django-dbbackup/commit/da2dc8d070a99aaf407458f730dcd0d46c97a903


Update machine-learning-multi-geo.md

Copying experiments across workspaces from different region is now enabled using PowerShell.

Hi @hning86, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@hning86 : Thanks for your contribution to the Azure documentation! The author, @tedway, has been notified to review your proposed change.

Moved to private repo.