How to flash into ESP8266

Hi guys, I am very new to use this kind of thing here. Sorry for that, as I have read all of your md file. I found it is interesting for me to use your project. But what I don't understand is that how to upload your project into ESP8266 model. I use Windows OS. Do I need to compile all the project?. What I have done is download those 2 bin files 0x00000 and 0x10000 and input them into Download tool V.3.44 and set parameters according to your sample. But the error log said
EFUSE NORMAL MODE
EFUSE CHECK PASS...
48bit mac
debug:
5c cf 7f f0 2c ca
CUSTOM_ID: 06 40 00 00 00 09 40 00
CUSTOM_ID:<PHONE_NUMBER>094000
crc_efuse_4bit: 0
crc_calc_4bit: 14
48bit mac
MAC AP : 5E-CF-7F-F0-2C-CA
MAC STA: 5C-CF-7F-F0-2C-CA
get mac res:  True
('tttest uuuuuuuuuuart : uart reg: ', 458)
(' baudrate: ', 115200)
get crystal: 26380800
get flash id : 0xff1640e0
manufacturer_id: 0xe0
device_id: 0x4016
vendor: 224
mode: 64
size: 22
DEBUG!!!!
SET FLASH PARAMS
filename:  D:\Users\Peth\Desktop\FLASH_DOWNLOAD_TOOLS_V3.4.4\bin_tmp\downloadPanel1\0x00000.bin_rep
offset :  0
filename:  D:\Users\Peth\Desktop\FLASH_DOWNLOAD_TOOLS_V3.4.4\bin_tmp\downloadPanel1\0x10000.bin
offset :  65536
Erasing flash in old style...

pic path: ./RESOURCE/DOWNLOAD_S.bmp

Traceback (most recent call last):
File "download_panel_info.pyo", line 539, in update_pic
AttributeError: ESPDOWNLOAD instance has no attribute 'ESP_MAC_BT'
Took 0.47s to erase flash block
Erasing flash in old style...
Took 1.92s to erase flash block
TEST !!!!
FAST BAUD: 230400
fACTORY REBOOT MODE:  False
Running Cesanta flasher (speed 230400)...
params:
MEMORY START
ELSE.... 26
Invalid head of packet ('')
Exception in thread Thread-2:
Traceback (most recent call last):
File "threading.pyo", line 801, in __bootstrap_inner
File "download_panel_info.pyo", line 785, in run
File "esptool_api.pyo", line 763, in flash_download_thread
File "esptool_api.pyo", line 1761, in init
File "esptool_api.pyo", line 1646, in read_packet
Exception: Invalid head of packet ('')
Could you please figure me out. Thanks

hey there. I just flashed my ESP8266 and it works like charm. Install esptool (it uses python)
pip install esptool
and then:
esptool.py --port /dev/ttyUSB0 write_flash 0x00000 firmware_sdk_1.5.4/0x00000.bin 0x40000 firmware_sdk_1.5.4/0x40000.bin
I had to flash firmware_sdk_1.5.4 but it works perfectly. (I did this on a Linux machine (Ubuntu 16.04))

I use ESP8266 download tool and send two binary files to ESP. After restart they blinking but can not find network to connect to. Did I need to sent to ESP8266 anything else of files in folder?

So I downloaded ESPFlashDownloadTool_v3.6.3 and was able to flash the 1.5.4 firmware to 0x0 and 0x4 but nothing happened.  I then flashed the latest 0x0 and 0x1 firmware from this project.  Now my NodeMCU's LED flashes constantly but I don't see any WiFi access point per the instructions.  I'm not even sure the flashing tool worked properly, all I get at the end of a flash is "48 bit mac".  Then I tried the "erase" option on the tool and flashed again, no difference.

Did you try DIO mode of the flasher? If so: did you try that:
Sometimes, especially on old ESP-01s, there is a wrong or non-matching version of "esp_init_data_default.bin" in the flash. If the firmware files from above flash correctly but after reboot you see only garbage on the serial and/or the LED on GPIO2 is flashing rapidly, try to re-initialize this sector: download https://github.com/espressif/ESP8266_NONOS_SDK/raw/master/bin/esp_init_data_default_v08.bin and flash it to 0x7c000 for 512 kB modules (some ESP-01, Sonoff Switch), 0xfc000 for 1 MB modules (most ESP-01), or 0x3fc000 for 4 MB modules (most ESP-12, Wemos D1).

Mine is a v.2 NodeMCU.  I admit I'm a complete novice at this why does the manufacturer tolerate crappy flashing tools with bad feedback and mysterious settings?  I'd think they would make a rock solid tool to help us more.

Connect to ESP with serial monitor like Arduio IDE, chose right baud rate
and send instructions for changing and activating wifi. Then connect thru
wireless connection. Instructions are on the web page. By the way
everything works fine with ESP8266 any type.
Regards
Goran
2018-02-03 0:17 GMT+01:00 James Bell<EMAIL_ADDRESS>
So I downloaded ESPFlashDownloadTool_v3.6.3 and was able to flash the
1.5.4 firmware to 0x0 and 0x4 but nothing happened. I then flashed the
latest 0x0 and 0x1 firmware from this project. Now my NodeMCU's LED flashes
constantly but I don't see any WiFi access point per the instructions. I'm
not even sure the flashing tool worked properly, all I get at the end of a
flash is "48 bit mac". Then I tried the "erase" option on the tool and
flashed again, no difference.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-362737488,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AQNJwchH2qNx_r8OYedxi1j1LpnyyhXRks5tQ5eMgaJpZM4NlCLs
.

Downloaded the latest files today & now struggling I have read different things older things & ahh
Ok I have the files above... I would love to flash a recent Sonoff Basic it takes a 1M flash
say I used esptool.py - what command line should I use ?
I have been using 1M firmwares and everything has gone well
but these are in pieces
here's what works - change anything ?
esptool.py.exe --port COM5 write_flash -fs 1MB -fm dout 0x0My_Firmware.bin
Thanks, excited to try this out on Sonoff & happy to give feedback
Cheers

Use:
For each firmware version:
esptool.py --port COM5 write_flash -fs 4MB -ff 80m -fm dio 0x00000
0x00000.bin 0x10000 0x10000.bin
And once for the Sonoff:
esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0xfc000
esp_init_data_default_v08_vdd33.bin
Am 6. März 2018 1:21:19 nachm. schrieb Oxyandy<EMAIL_ADDRESS>

Downloaded the latest files today & now struggling I have read different
things older things & ahh
Ok I have the files above... I would love to flash a recent Sonoff Basic it
takes a 1M flash
say I used esptool.py - what command line should I use ?
I have been using 1M firmwares and everything has gone well
but these are in pieces
here's what works - change anything ?
esptool.py.exe --port COM5 write_flash -fs 1MB -fm dout 0x0My_Firmware.bin
Thanks, excited to try this out on Sonoff & happy to give feedback
Cheers
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370764122

wow so fast ! Thanks Martin
MUCH appreciated

STAGE 1 - Looks OK
`esptool.py --port COM5 write_flash -fs 4MB -ff 80m -fm dio 0x00000 router\0x00000.bin 0x10000 router\0x10000.b
in
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Compressed 48876 bytes to 12029...
Wrote 48876 bytes (12029 compressed) at 0x00000000 in 1.1 seconds (effective 365.1 kbit/s)...
Hash of data verified.
Compressed 48876 bytes to 12028...
Wrote 48876 bytes (12028 compressed) at 0x00010000 in 1.1 seconds (effective 364.7 kbit/s)...
Hash of data verified.
Leaving...
Hard resetting...STAGE 1 - Looks BAD :(esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0xfc000 router\esp_init_data_default_v08_vdd33.bin
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
A fatal error occurred: File router\esp_init_data_default_v08_vdd33.bin (length 49203) at offset 1032192 will not fit in 1048576 bytes of flash. Use --flash-size argume
nt, or change flashing address.`
Thanks again ;)

Okay, Sonoff has only 512k - use address 0x7c000
Am 6. März 2018 1:43:50 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
STAGE 1 - Looks OK
`esptool.py --port COM5 write_flash -fs 4MB -ff 80m -fm dio 0x00000
router\0x00000.bin 0x10000 router\0x10000.b
in
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Compressed 48876 bytes to 12029...
Wrote 48876 bytes (12029 compressed) at 0x00000000 in 1.1 seconds
(effective 365.1 kbit/s)...
Hash of data verified.
Compressed 48876 bytes to 12028...
Wrote 48876 bytes (12028 compressed) at 0x00010000 in 1.1 seconds
(effective 364.7 kbit/s)...
Hash of data verified.
Leaving...
Hard resetting...STAGE 1 - Looks BAD :(esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0xfc000
router\esp_init_data_default_v08_vdd33.bin
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
A fatal error occurred: File router\esp_init_data_default_v08_vdd33.bin
(length 49203) at offset 1032192 will not fit in 1048576 bytes of flash.
Use --flash-size argume
nt, or change flashing address.`
Thanks again ;)
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370769714

OK, that looks happier..
esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0x7c000 router\esp_init_data_default_v08_vdd33.bin
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Compressed 49204 bytes to 12040...
Wrote 49204 bytes (12040 compressed) at 0x0007c000 in 1.1 seconds (effective 367.5 kbit/s)...
Hash of data verified.

Leaving...
Hard resetting...

Should be LED ? Nudda
<IP_ADDRESS> took too long to respond.
Serial output at 150000 baud
r␘␂␀l��r�␀�#␂�n�␄��␌␘�␌␜��␜p�|���␀�8␂��ǒ��l␜p␌␘␌�nn�␂�;�nĒ��␌␛�␌b�#l␛$␛$��r���w␂␒n��bp␀�
Next, (other that me saying thanks for your time & this should help others)
The firmwares I flash & backup are 1024 Kb
Cheers

On the Sonoff: No LED by default
Use 115200 (!) on serial: should look more readable: Something like version
info.
AP "MyAP" should appear on WiFi...
Am 6. März 2018 1:56:46 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
OK, that looks happier..
esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0x7c000
router\esp_init_data_default_v08_vdd33.bin
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Compressed 49204 bytes to 12040...
Wrote 49204 bytes (12040 compressed) at 0x0007c000 in 1.1 seconds
(effective 367.5 kbit/s)...
Hash of data verified.

Leaving...
Hard resetting...

Should be LED ? Nudda
<IP_ADDRESS> took too long to respond.
Serial output at 150000 baud
r␘␂␀l??r?␀?#␂?n?␄??␌␘?␌␜??␜p?|???␀?8␂??ǒ??l␜p␌␘␌?nn?␂?;?nĒ??␌␛?␌b?#l␛$␛$??r???w␂␒n??bp␀?
Next, (other that me saying thanks for your time & this should help others)
The firmwares I flash & backup are 1024 Kb
Cheers
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370772744

Yes sorry I used the right baud before, just typed it wrong
I just tried changing DIO to DOUT & redoing both..
Should I use the erase command too?
--- Miniterm on COM5  115200,8,N,1 ---
--- Quit: Ctrl+C | Menu: Ctrl+T | Help: Ctrl+T followed by Ctrl+H ---
␀r␘␂␀l��r�␀�#␂�n�␄��␌␘�␌␜��␜p�<���␀�8␂��ǒ��l␜p␌␘␌�nn�␂�;�nĒ��␌␛�␌b�#l`␛$`␛$��r��Iw␂␒n��bp␀

Thanks

Think, erase ist not required. Can you flash any other binary? E.g. Tasmota?
Am 6. März 2018 2:09:09 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
Yes sorry I used the right baud before, just typed it wrong
I just tried changing DIO to DOUT & redoing both..
Should I use the erase command too?
--- Miniterm on COM5  115200,8,N,1 ---
--- Quit: Ctrl+C | Menu: Ctrl+T | Help: Ctrl+T followed by Ctrl+H ---
␀r␘␂␀l??r?␀?#␂?n?␄??␌␘?␌␜??␜p?<???␀?8␂??ǒ??l␜p␌␘␌?nn?␂?;?nĒ??␌␛?␌b?#l`␛$`␛$??r??Iw␂␒n??bp␀

Thanks
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370775846

Yes, I flash ESPeasy, ESPurina & Tasmota etc no problem
& make use of configured back-ups
Thanks

esptool.py.exe --port COM5 erase_flash
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Erasing flash (this may take a while)...
Chip erase completed successfully in 2.8s
Hard resetting...

Starting fresh

You should ist the same parameters...
Am 6. März 2018 2:13:12 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
Yes, I flash ESPeasy, ESPurina & Tasmota etc no problem
& make use of configured back-ups
Thanks
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370776813

Just tried
esptool.py --port COM5 write_flash -fs 1MB -fm dout 0x00000 router\0x00000.bin 0x10000 router\0x10000.bin
Powered Sonoff off, then On again into flash and
sptool.py --port COM5 write_flash -fs 1MB -fm dout 0x7c000 router\esp_init_data_default_v08_vdd33.bin
Now serial only says #␀#

If parameters are the same I should be able to do one line ?
esptool.py --port COM5 write_flash -fs 1MB -fm dout 0x00000 router\0x00000.bin 0x10000 router\0x10000.bin  0x7c000  router\esp_init_data_default_v08_vdd33.bin

Doesn't look good. Can you check the SHA-1 checksums of the binary files?
It definitly runs on a Sonoff Basic...
Am 6. März 2018 2:23:41 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
Just tried
esptool.py --port COM5 write_flash -fs 1MB -fm dout 0x00000  router\0x00000.bin 0x10000 router\0x10000.bin
Powered Sonoff off, then On again into flash and
sptool.py --port COM5 write_flash -fs 1MB -fm dout 0x7c000
router\esp_init_data_default_v08_vdd33.bin
Now serial only says #␀#
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370779545

Yes, one line is fine.
Am 6. März 2018 2:26:53 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
If parameters are the same I should be able to do one line ?
esptool.py --port COM5 write_flash -fs 1MB -fm dout 0x00000  router\0x00000.bin 0x10000 router\0x10000.bin  0x7c000   router\esp_init_data_default_v08_vdd33.bin
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370780490

ah you are right no need for SHA1 files.. I just opened in a text editor and oops html only how could I not notice the size too... sorry

esptool.py --port COM5 write_flash -fs 1MB -fm dout 0x00000 router\0x00000.bin 0x10000 router\0x10000.bin 0xfc000 router\esp_init_data_default_v08_vdd33.bin
Now the serial out is saying strange stuff
WiFi Repeater V1.7.2 starting

No config found, saving default in flash
Loading default configuration
Saving configuration
Starting Console TCP Server on port 7777
Starting Web Config Server on port 80
mode : sta(5c:cf:7f:72:98:03) + softAP(5e:cf:7f:72:98:03)
add if0
add if1
dhcp server start:(ip:<IP_ADDRESS>,mask:<IP_ADDRESS>,gw:<IP_ADDRESS>)
bcn 100

THANKS so much Martin, best wishes for you - a nice single to flash

Am I allowed to find bugs ?
Should I open a new bug report ?
Plus is there a manual somewhere, I have been making use of help cmd in serial
obviously there is much more to this..
Should the access point have the same number as my home router ?
I try change it, but it stays same (anyhow basic users guide would be cool)
Thanks for all the time you put into this project Martin, legend

Please report any suspected bug in a new issue. You are welcome to improve
the project.
Up to now the Readme.md ist the documentation.
The networks should bei different:
set network x.x.x.x
save
reset
Am 6. März 2018 5:19:38 nachm. schrieb Oxyandy<EMAIL_ADDRESS>
Am I allowed to find bugs ?
Should I open a new bug report ?
Plus is there a manual somewhere, I have been making use of help cmd in serial
obviously there is much more to this..
Should the access point have the same number as my home router ?
I try change it, but it stays same (anyhow basic users guide would be cool)
Thanks for all the time you put into this project Martin, legend
--
You are receiving this because you commented.
Reply to this email directly or view it on GitHub:
https://github.com/martin-ger/esp_wifi_repeater/issues/42#issuecomment-370837379

Thanks Martin, another day here and I am feeling a little bit foolish,
the Readme.md is going to be most useful, I will read it over many times I am sure..
You are bound to get some interesting feedback from me because you have encouraged me to
"improve the project." - This makes me feel like my words/feedback will not be wasted, so will go into detail as much as possible.. Saving a local copy to compile at home.
I really appreciate the time you have given responding to me & sorry I messed some of it up, I usually do not right click links and "Save Target As".. (html bins) - wont do that again, cheers

ESP WiFi NAT Router Config
AP Settings
Attempting to change the SSID: results in
The new settings have been sent to the device...
After a little bit page reloads, but AP SSID does not change ?
It is currently the same SSID as STA Settings
Is it intentional that they are the same ?
I am attempting to get my far away outdoor devices connected as Primary Network, with my home router set in these far away devices as secondary..
Anyway it might be mentioned in the Wiki, I will go search that for " SSID " and read what I find, otherwise is a bug..
I tried doing this while connected to my serial cable, but admit I did not send the save command..
Off to read & soak it in

Followed by reset - then show cmd again

Why AP SSID will not stick ? waaaa

You have 'automesh' ob (1). With automesh STA and AP seid are always equal.
Do
set automesh 0
If you want a individual ap_ssid
Am 7. März 2018 1:30:23 vorm. schrieb Oxyandy<EMAIL_ADDRESS>Followed by reset - then show cmd again
Why AP SSID will not stick ? waaaa
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

I never changed it Martin, it must be set default 'on' in the source, anyway that is neither here nor there if the read me had a little extra info, my head would hurt less.. Kept thinking I was doing something wrong with the way I was setting things
As newbie I have the prospective of one, well obviously ;)
And hope you do not mind my feedback ramblings of where I am getting stuck, it might give you some insight, so maybe I could so some 'Read me' edits ?
Some extra words & some rewording maybe needed in a few places
example something like this (pic below) would have helped & doesn't this text also need the step
set ap_open 0
too ?

Top check it: please try 'reset factory' .
This resets to default values (same function at first boot) , should switch
automesh off.
Am 7. März 2018 3:43:14 vorm. schrieb Oxyandy<EMAIL_ADDRESS>I never changed it Martin, it must be set default 'on' in the source,
anyway that is neither here nor there if the read me had a little extra
info, my head would hurt less.. Kept thinking I was doing something wrong
with the way I was setting things
As newbie I have the prospective of one, well obviously ;)
And hope you do not mind my feedback ramblings of where I am getting stuck,
it might give you some insight, so maybe I could so some 'Read me' edits ?
Some extra words & some rewording maybe needed in a few places
example something like this (pic below) would have helped & doesn't this
text also need the step
set ap_open 0
too ?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

Hi again, a few things..
The most important one - I am running ESPeasy Firmware on 2 devices I want to extend the range on through another Sonoff running your firmware - not been able to once yet..
Now after much thought, maybe it is because I have them set as static IPs <IP_ADDRESS> & <IP_ADDRESS>
They connect but I can never view the web configuration page, yes I know I can remove the static IP assignments and try again, but I use those for quick, hassle free direct access - if I ever needed to access them, which at the moment is frequent enough..
I see 3 connected devices (1 is my main PC & I can get to the net through that)
see image

I assume the 2 without MAC addresses are my devices...
Options ? please, thanks again

Yes, devices without DHCP mapping so not appear in the list - but they
should work anyway.
But even If you use static addresses, these must belong to the repeaters AP
subnet, default 192.168.4.x. You might change that subnet, but it should
bei different from the upstream IP Network.
Am 7. März 2018 7:49:18 vorm. schrieb Oxyandy<EMAIL_ADDRESS>Hi again, a few things..
The most important one - I am running ESPeasy Firmware on 2 devices I want
to extend the range on through another Sonoff running your firmware - not
been able to once yet..
Now after much thought, maybe it is because I have them set as static IPs
<IP_ADDRESS> & <IP_ADDRESS>
They connect but I can never view the web configuration page, yes I know I
can remove the static IP assignments and try again, but I use those for
quick, hassle free direct access - if I ever needed to access them, which
at the moment is frequent enough..
I see 3 connected devices (1 is my main PC & I can get to the net through that)
see image
I assume the 2 without MAC addresses are my devices...
Options ? please, thanks again—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

Ok strange, while 2 were connected - each with a static IP assignment (in the device itself),
I could never type the IP into the address bar and connect, I removed the assignment and just 'one' and now they both show in the browser :O one as it's proper http://<IP_ADDRESS>
the other assigned DHCP http://<IP_ADDRESS> - both with RSSI figures under -70 - so , much better
About to undo the change as see if it reverts to being unable to access either device's webconfig page..

What I should have added before

See that check box, ignorance by me may have checked it the first time round, so when I said before this might be enabled by default in the source, might not be true at all - learning..
But I am seeing in read me
set phy_mode [1|2|3]: sets the PHY_MODE of the WiFi (1=b, 2=g, 3=n(default))
and finally found repeater is 802.11g, my computer doesn't care, but seems my router hates it, so changing that to n now like everything else here.
Now to assign both static again and see if it reverts, but set phy_mode 3first

SationAP mode only uses g-mode, even when n ist configured.
Am 7. März 2018 8:52:11 vorm. schrieb Oxyandy<EMAIL_ADDRESS>What I should have added before
See that check box, ignorance by me may have checked it the first time
round, so when I said before this might be enabled by default in the
source, might not be true at all - learning..
But I am seeing in read me
set phy_mode [1|2|3]: sets the PHY_MODE of the WiFi (1=b, 2=g, 3=n(default))
and finally found repeater is 802.11g, my computer doesn't care, but seems
my router hates it, so changing that to n now like everything else here.
Now to assign both static again and see if it reverts, but set phy_mode 3first
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

set phy_mode 3
WOW, huge difference pages from the internet loaded slowly now BAM
complex little sucker to fine tune

Hello Martin, I must be doing something wrong
As it is now, I have my home network & repeater as different SSIDs
I returned my devices to static and they both connect to the repeater as preferred network, if I join the repeater with my PC, as static I get  both devices web pages to load quickly
That part works good.. If I try to load an external webpage nothing loads. (no internet access)
repeater is showing as connected to my home router - has host name ESP_xxxx & IP
If I leave my devices connected to repeater and shift my PCs wireless connection back to home network & type the devices IPs - nothing opens
Try repeaters IP again doesnt load
Here is what I want to do, I want to just use the repeater as a repeater to boost signals on them both so they can be accessed on main PC at a better strength.. Type in their IP and they load..
Do I have the wrong mode? Suggestions please

Automesh mode
http://<IP_ADDRESS> Repeaters page loads, devices show as connected but their pages will not load on main PC connected on same router as repeater.

Let me try to explain: let's call the uplink side to the internet (STA of the ESP) "outside" and the other side, tha AP side of the ESP where the clients are "inside". Those two sides have different IP subnets and addresses.
Nodes from the inside can connect to the internet as their addresses are translated via NAT to the outside address of the ESP. Their requests look to the outside node as if they would come from the ESP itself. This translation is learned dynamically from the requests and it is stored temporarily in the NAT tables of the ESP. Replies are translated again in the reverse direction to the inside addresses.
But you cannot directly access inside nodes from the outside, as there is not translation known. What you have to do is: define a static translation from the outside addr/port of the ESP to the inside addr/port of the nodes. I.g.: your outside addr of the ESP is <IP_ADDRESS>, the IP address of the internal node is <IP_ADDRESS>, you want to do a web-request to the inside node from your PC outside. Define a mapping:

portmap TCP 80 <IP_ADDRESS> 80
and access the outside addr of the ESP: http://<IP_ADDRESS>:80. You will be redirected to the inside node port 80.

If you have a second inside node, let's say <IP_ADDRESS>, use a different outside port and do:

portmap TCP 81 <IP_ADDRESS> 80
and access the outside addr of the ESP: http://<IP_ADDRESS>:81. You will be redirected to the second inside node port 80.

If you inside addresses are static this is fairly easy, if you use DHCP for dynamic addresses here set it all up once and use:

save dhcp
to save the current assignment of the inide addresses.

Hope this explains. Transparent bridging on ISO layer 2 would avoid that (what a real WiFi REPEATER does) but as far as I know today, this cannot be done with the ESP drivers as they are...

Thanks again Martin, excellent explanation, I had to get another router & configure it to an access point, the sonoffs I am using control a garden so I had to resolve connectivity first, in a few days I will return to see if I can get you code running again..
Just a bit behind on other chores -
Cheers

STAGE 1 - Looks OK
esptool.py --port COM5 write_flash -fs 4MB -ff 80m -fm dio 0x00000 router\0x00000.bin 0x10000 router\0x10000.b
in
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...
Compressed 48876 bytes to 12029...
Wrote 48876 bytes (12029 compressed) at 0x00000000 in 1.1 seconds (effective 365.1 kbit/s)...
Hash of data verified.
Compressed 48876 bytes to 12028...
Wrote 48876 bytes (12028 compressed) at 0x00010000 in 1.1 seconds (effective 364.7 kbit/s)...
Hash of data verified.

Leaving...
Hard resetting...

STAGE 2 - Looks BAD :(
esptool.py --port COM5 write_flash -fs 1MB -ff 80m -fm dio 0xfc000 router\esp_init_data_default_v08_vdd33.bin
esptool.py v2.2.1
Connecting....
Detecting chip type... ESP8266
Chip is ESP8266EX
Uploading stub...
Running stub...
Stub running...
Configuring flash size...

A fatal error occurred: File router\esp_init_data_default_v08_vdd33.bin (length 49203) at offset 1032192 will not fit in 1048576 bytes of flash. Use --flash-size argume
nt, or change flashing address.

Thanks again ;)

Stage 1 Works

What kind of ESP8266 do you have? Why "-fs 1MB" in the scond command?

This one worked for me
esptool.py--port_ /dev/ttyUSB0 write_flash -fs 4MB -ff 80m -fm dio 0x00000 router\0x00000.bin 0x10000 router\0x10000.bin

Normal ESP12, should use "-fs 4MB"

I actually quoted a comment of Oxyandy from there.


Doc: new docs demands from slack

A colleague of mine asked the following questions:
My questions around a cloudberry DB that is used as a datawarehouse (OLAP applications, reporting/BI)
• any specific optimization options for analytical queries / aggregation functions
• best practices in the data model design (star/snowflake-schema; normalized vs. denormalized; redundancy issues)
• best practices in the configuration
• any thoughts on massive deletes
• any thoughts on doing outer joins of 10+ tables
• any specific recommendations regarding partioning, indexing, views/materialized views,...
Slack Message

Few ideas here based on experiences:

Use ORCA and encourage hash join and hash aggregate for OLAP queries
Use "star", don't use "snowflake" to reduce the number of joins, denormalize your data to change join into filters
Configuration, this deserve its own book
Partition your data, so that you don't delete, just drop the entire partition
Outer join of 10+ tables? well, answered in the first one, rely on ORCA, or answered in the second one, use star schema to reduce the number of joins
Unless you do singleton lookup, don't index. Views are only for management purpose, not for performance. Materialized views would be a great idea if you have a relative fixed workloads. For the partition, make your partition medium sized, and leverage the static and dynamic partition elimination.

Again, those are very high level ideas to optimize for "append-only, truncate-only, mostly read-only" OLAP workloads. If you are thinking OLTP or any HTAP workloads, the above recommendation will not work.
I agree with @tuhaihe that, we need to have extended documentation with general guidance as well as real world cases to demonstrate the tradeoff for the guidance above. Those are great questions, and please keep asking. Thanks.

Here is a deck I share with my clients who are building a data warehouse (deck is generic and part of larger demo I do).  It's showing generic code I built and provide for customers but it also shows my conceptual best practices.  You can see I lean towards a Kimball based model (star or snowflake) because most of the time I'm pushing my customers towards a self-service BI model and feel dimensional modeling is the easiest for business users to understand.   Physical design on this for me generally leads towards  dimensions being AO columnar compressed and facts being AO row compressed and usually partitioned on one of the primary dates.
I just started working with a new data modeling tool called DbSchema (https://dbschema.com/) and gave them code for Greenplum that they recently incorporated into the product so it's my tool of choice.
One warning though, A LOT depends on the BI tool being used.  You need to make sure the tool is pushing down the aggregation and only pulling back the columns the user is "slicing and dicing on" as shown by the Tableau examples in the deck (look at the queries from the DB side).  Other tools don't generate good queries and want to just extract everything (horrible) in which case columnar wouldn't work well (honestly nothing works well with those tools, might as well just feed them flat files)
reporting_db_design_example.pdf


Python Project Tells you day on which you born #4541

Title and Issue number

Python Project Tells you day on which you born #4541
Close #4541

Checklist:

[X] I have mentioned the issue number in my Pull Request.
[X] I have commented my code, particularly in hard-to-understand areas
[X] I have created a helpful and easy to understand README.md

@MohitGupta121
Kindly merge it.


Add support for blake2s

Currently only blake2b is supported and I had to look at the source to figure this out.
I'd say that the blake2 should be made alias  for blake2b (or removed better as this is simple search and replace through PHP code) and blake2s support added.

I had added a PR #6 for this.

Closed by #6.


for iPad, no matter what orientation in what screen width mode, tabba…

…rview will always be 48 pt height.
Platforms Impacted

[x] iOS
[ ] macOS

Description of changes
In all orientations of iPad, tabbar will have 48pt height (not including the home indicator).
Verification
iPhone, iPad (compact/regular mode)

Before
After

Pull request checklist
This PR has considered:

[x] Light and Dark appearances
[ ] VoiceOver and Keyboard Accessibility
[ ] Internationalization and Right to Left layouts
[ ] Different resolutions (1x, 2x, 3x)
[x] Size classes and window sizes (iPhone vs iPad, notched devices, multitasking, different window sizes, etc)

Microsoft Reviewers: Open in CodeFlow

@harrieshin can you clarify what the "before" image is in reference to?

Looks good to me. Thanks @harrieshin!


Adding string tests

After https://github.com/mattn/go-oci8/pull/274

FYI, been trying to figure out OCI string binds to get string length back. Have tried a handful of ways and nothing seems to be working yet.

FYI, been trying to figure out OCI string binds to get string length back. Have tried a handful of ways  and nothing seems to be working yet.

do you speaking for output parameters ?
to get back string len, bind it as   C.SQLT_STR  (only if this is output parameter) // N+1 character NULL terminated string
and set *cdata to 0 ('\0')

That gets you back a null terminated string. How do you get the length back, regardless of what kind of string is used?

gostring = C.GoString((*C.char)(col.pbuf))

because it is null terminated, you cat find this 0 and calculate len
limitation is that you returned string cant contain 0 character

Exactly, which brings me back to how does one get the string length back regardless of what kind of string is used?

Ok, now i understood you question.
dont know if this help you, but just discover in oracle docs:
Output
Specify the desired length for the return value in the value_sz parameter of the OCIDefineByPos() call, or the value_sz parameter of OCIBindByName() or OCIBindByPos() for PL/SQL blocks. If zero is specified for the length, no data is returned.
If you omit the rlenp parameter of OCIDefineByPos(), returned values are blank-padded to the buffer length, and NULLs are returned as a string of blank characters. If rlenp is included, returned values are not blank-padded. Instead, their actual lengths are returned in the rlenp parameter.
To check if a NULL is returned or if character truncation has occurred, include an indicator parameter in the OCIDefineByPos() call. Oracle sets the indicator parameter to -1 when a NULL is fetched and to the original column length when the returned value is truncated. Otherwise, it is set to zero. If you do not specify an indicator parameter and a NULL is selected, the fetch call returns the error code OCI_SUCCESS_WITH_INFO. Retrieving diagnostic information on the error will return ORA-1405.

If you omit the rlenp parameter of OCIDefineByPos(), returned values are blank-padded to the buffer >length, and NULLs are returned as a string of blank characters. If rlenp is included, returned values >are not blank-padded. Instead, their actual lengths are returned in the rlenp parameter.

so this seem easy, with 1 more variable in oci8bind struct

@djadala Thank you, looking into this.

@djadala
I tried using alenp, it gives me the max length 32767. Had the same issue when using OCIBindDynamic. Not sure what I am doing wrong.
Here is the code if you want to look at it, work in progress, don't mind the mess.
https://github.com/MichaelS11/go-oci8/tree/temp

it works for me !
now i post here short instructions,
because i work very old version of this driver, and i made some changes so it diverged from original.
i need some time to bring my version in sync, but until that here are instructions:
1 add to struct oci8bind  alen pionter:
type oci8bind struct {
	kind C.ub2
	alen *C.ub2
	pbuf unsafe.Pointer
	out  interface{} // original binded data type
}

2 in bind function, allocate 2 bytes, and set value to actual string len:
		s.pbind[i].alen = (*C.ub2)(C.malloc(2))
		*s.pbind[i].alen = 0 //(C.ub2)(clen)
		if rv := C.OCIBindByPos(
			(*C.OCIStmt)(s.s),
			s.bp,
			(*C.OCIError)(s.c.err),
			C.ub4(i+1),
			unsafe.Pointer(cdata),
			clen,
			dty,
			nil,
			// nil,
			s.pbind[i].alen,
			nil,
			0,
			nil,
			C.OCI_DEFAULT); rv != C.OCI_SUCCESS {
			defer freeBoundParameters(s.pbind)
			return nil, ociGetError(rv, s.c.err)
		}

as i understand, in this case clen is total buffer size, and alen is actual string size, so one can pass small input string, and then receive larger output string.
for output parameters, i suggest clen to be set (and allocated) to 4000 - max oracle varchar  len.
3 in outputBoundParameters:
			switch v := col.out.(type) {
			case *string:
				*v = string((*[1 << 24]byte)(col.pbuf)[0:*col.alen])

4 don't forget to free alen in freeBoundParameters
Regards

@djadala
Could you look at the code in https://github.com/MichaelS11/go-oci8/tree/temp ?
https://github.com/MichaelS11/go-oci8/blob/temp/statement.go#L207-L214
https://github.com/MichaelS11/go-oci8/blob/temp/statement.go#L836-L855

https://github.com/MichaelS11/go-oci8/blob/1a41cdbd8af0c42b7aa4bdcd206aaec18244fa9d/statement.go#L207
you are getting 32767 because binding is  SQLT_AFC,  it always expand string with spaces. try using SQLT_CHR.  I use SQLT_AFC for input strings  because SQLT_CHR trim trailing spaces, if you pass ' '(1 space), it is trimmed to '' and this is converted to NULL, using SQLT_AFC for input strings ensure that they are preserved exactly.
But for output strings, things are different. you can use even SQLT_STR (nul terminated string),  because  OCIBindByPos set correctly alen, and you use it to determine string len.

@djadala
Thank you very much for your help. Been going crazy trying to figure this out. Think I got it working correctly now.

@mattn
My apologies for the large PRs. They should be ready to go.
Please let me know if there are any questions or concerns.

LGTM

Thanks!


Do you plan to release the fine-tuned weights for vision transformers?

I assume the current one is not fine-tuned on imageNet, since the prediction is completely off.

That model validated at over 84% top-1, those are the imagenet21k->1k fine tuned weights. You must have something wrong in your script

Sorry, I can't tell what is wrong here. But maybe I am not doing it right. I just copied the example from the official repo and replace it with your model, the prediction seems to be very different.
https://github.com/google-research/vision_transformer/blob/master/vit_jax.ipynb

@KaizhaoLiang looks like there is an issue with the model creation fn (vit_base_patch16_384()) and the default args, I've only been testing/using the timm.create_model('vit_base_patch16_384', pretrained=True) factory lately and I believe that should work for you. I'll look into fixing the arg handling though and I should add a unit test for that...
Otherwise, I see you fixed the channel order, so should work with those two things.

Thanks, timm.create_model works for me.

Thanks, timm.create_model works for me.
@rwightman

Do we need to transpose the width and height order ?

I assume the current one is not fine-tuned on imageNet, since the prediction is completely off.

Why do you transpose the width and height order?


Update option don't work

Hi, the option "Update" don't work and say
"Failed to check for update
Result code 0xD963F806
Level: Premanent (27)
Summary: Internal (11)
Module: Application (254)
Desc: Bad data (6)"

Looks like there's another duplicate entry for FBI in TitleDB now. The updater will be fixed in the next release, whenever I can finally get around to it.

Should be addressed in source.


Running error

When I change the path of duts's training set, I get some error like
torch.backends.cudnn.CuDNNError: 4: CUDNN_STATUS_INTERNAL_ERROR
Exception ctypes.ArgumentError: "argument 1: <type 'exceptions.TypeError'>: Don't know how to convert parameter 1" in <bound method CuDNNHandle.del of <torch.backends.cudnn.CuDNNHandle instance at 0x7fc76508a248>> ignored
Could you upload a guidance that explain how to use your code for convenience?

I am sorry. I didn't see that error before, so it's hard to solve that problem. Can you find the line in my code that the error occured?  I think that you got the error because you don't have gpu to use cuda or cudnn.
My suggestion is in train.py 20 line,
device = torch.device("cuda")
to
device = torch.device("cpu")
This is my computing environment
NVIDIA gtx 1080ti
windows 10
python 3.5
pytorch 0.4.0
CUDA 9.0
CUDNN 7.0
And also there are some mismatch cases in DUTS dataset. Please check the dataset carefully.
I hope you solve this problem.


Add Pfizer fragmentation scheme

Description
Adds fragmentation scheme from this paper from Pfizer given that fragmenterWBO minimal fragmentation is slightly different and also requires WBO calculation which can be slow.
Todos
Notable points that this PR has either accomplished or will accomplish.

[x] Added new fragmentation scheme

Questions

[ ] It wasn't fully clear from the paper which functional groups were not fragmented
[ ] If the open valence N left after fragmentation was trivalent, do we still cap with methyl or add both carbons back? The current implementation adds both carbons.

Status

[ ] Ready to go

Codecov Report

Merging #54 into master will increase coverage by 2.9%.
The diff coverage is 81.44%.


Iptables Firwall Rules

Hello Nyr,
First of all, a praise to your script. Many Thanks.
Is it possible that you can give me the iptables rule separately times.
I have created an iptabels firewall script and would like to add the rules for the OpenVPN.
Input, Forwarding, Output, Nat, Routing
Many Thanks.

We have a little language barrier here. If I understood you, you are asking which rules is the script setting up, right?
It depends:

iptables is only used if firewalld is not enabled
If iptables is used, only the following rule is applied:
iptables -t nat -A POSTROUTING -s <IP_ADDRESS>/24 ! -d <IP_ADDRESS>/24 -j SNAT --to $IP
Except if the script detects DROP or REJECT rules active. If so, these are added too:
iptables -I INPUT -p $PROTOCOL --dport $PORT -j ACCEPT
iptables -I FORWARD -s <IP_ADDRESS>/24 -j ACCEPT
iptables -I FORWARD -m state --state RELATED,ESTABLISHED -j ACCEPT

If the system uses firewalld, the following rules are set up instead:
firewall-cmd --zone=public --add-port=$PORT/$PROTOCOL
firewall-cmd --zone=trusted --add-source=<IP_ADDRESS>/24
firewall-cmd --permanent --zone=public --add-port=$PORT/$PROTOCOL
firewall-cmd --permanent --zone=trusted --add-source=<IP_ADDRESS>/24
firewall-cmd --direct --add-rule ipv4 nat POSTROUTING 0 -s <IP_ADDRESS>/24 ! -d <IP_ADDRESS>/24 -j SNAT --to $IP
firewall-cmd --permanent --direct --add-rule ipv4 nat POSTROUTING 0 -s <IP_ADDRESS>/24 ! -d <IP_ADDRESS>/24 -j SNAT --to $IP

Please also note that this platform is just a tracker for issues with the script (bugs, improvements, suggestions...), so I'm closing this. If you need further assistance, I'd ask you to please go elsewhere.


minimum spec required to run the experiment

Hi i was trying to run beam search code, but got mem error, I was doing this experiement in aws g4dn x large instance have 16g memory,
what is the minimum specs i need to properly run this?

Hi @rohitmishra94, you could try reducing the number of samples generated per instance to reduce memory usage, try num_samples=5 and beam_size=2 for instance. Another (slower) option is to do a for loop over num_samples here - https://github.com/martiansideofthemoon/rankgen/blob/master/scripts/rankgen_beam_search.py#L103

hi @rohitmishra94, we've now uploaded the RankGen-base and RankGen-large models which should run on smaller GPUs (see README). I've also added an open issue #10 to create a Dockerfile for the project.


How to get names of images from idx of indexes_all in DC_V2?

❓How to get names of images from IDX of indexes_all in DC_V2?
Dear @iseessel, @QuentinDuval
Introduction -
Since the deepclusterv2_loss.py uses only loss_config therefore I cannot use what is suggested in #401. #401 uses other pieces of information from the main_config, for example, such as self.data_sources
I understand DC_v2_loss.py does not require the rest of the config information for loss calculation.
What have I done and understand -

For evaluation of the clusters, I have dumped  assignments  and all index values corresponding to assignments. (example attached

)
For data loading, I see dataloader is used here, _but I don't know how to get image names from the data loader_

Question -

Can somehow all the configurations be called so that I can use what is suggested in #401

Cheers,
DC

Hi there @DC95 -- I do agree it would be hard to extract the image names for the clusters while they are training.
However, it is easy to do so after the fact. You can use https://github.com/facebookresearch/vissl/issues/401 to save the image_paths, e.g. after this is called: https://github.com/facebookresearch/vissl/blob/87ef9a19c193dc91add9dd56bee1b9b701693672/vissl/data/ssl_dataset.py#L313
Then you can match the index of this array to the index that you have in indeces.

I have images in a folder (Train and Test separate) and I register them in dataset_catalog.json. So I think it's the Disk folder.

Got it -- then the above should work -- let me know if I'm not being clear!

Dear @iseessel,
As suggested by you, I looked into the file. But I have some questions-

What I understood is that self._load_labels() (line 313) is meant for loading labels (if the dataset has one).

But maybe I didn't tell you before -

I have unlabelled satellite images. I have applied DC_v2, and now I have the cluster ids and corresponding image indices. But I want to get the image file names.

Can you kindly tell me once more how to proceed with the solution? Maybe I misunderstood you.

Something like the following should work:
    def __getitem__(self, idx: int):
        """
        Get the input sample for the minibatch for a specified data index.
        For each data object (if we are loading several datasets in a minibatch),
        we get the sample: consisting of {
            - image data,
            - label (if applicable) otherwise idx
            - data_valid: 0 or 1 indicating if the data is valid image
            - data_idx : index of the data in the dataset for book-keeping and debugging
        }
        Once the sample data is available, we apply the data transform on the sample.
        The final transformed sample is returned to be added into the minibatch.
        """

        if not self._labels_init and len(self.label_sources) > 0:
            self._load_labels()
            self._labels_init = True

         from vissl.utils.io import save_file
         save_file(self.label_paths(), "/path/to/labels.json")

This file loads the images and optionally the labels if you have them.

Thanks, let me try :)

Dear @iseessel
I am sorry to report but,
I have tried both-
save_file(self.label_paths, "/path/to/label_path.txt") (txt file attached)
and
save_file(self.data_paths, "/path/to/data_path.txt") (txt file attached)
with self.label_paths it's coming as an empty list and more lists than no. of training files.
Kind note - If I use self.label_paths () then it's giving TypeError: 'list' object is not callable, that's why I removed the brackets.
data_path.txt
label_path.txt

Sorry I had a typo in my original. Can you try something like:
    def __getitem__(self, idx: int):
        """
        Get the input sample for the minibatch for a specified data index.
        For each data object (if we are loading several datasets in a minibatch),
        we get the sample: consisting of {
            - image data,
            - label (if applicable) otherwise idx
            - data_valid: 0 or 1 indicating if the data is valid image
            - data_idx : index of the data in the dataset for book-keeping and debugging
        }
        Once the sample data is available, we apply the data transform on the sample.
        The final transformed sample is returned to be added into the minibatch.
        """

        if not self._labels_init and len(self.label_sources) > 0:
            self._load_labels()
            self._labels_init = True

         from vissl.utils.io import save_file
         save_file(self.get_image_paths(), "/path/to/labels.json")

Dear @iseessel
I followed your suggestion but -

In disk_dataset.py, line 139-
image_path = self.image_dataset[idx] has information like - (<PIL.Image.Image image mode=RGB size=128x128 at 0x2B69DB5866A0>, 0) for each image but this does not contain information like I thought.

One more thing interesting is that I looked at the IDX values getting called in def getitem()  of disk_dataset.py. It is storing IDX values almost twice the number of training size, each IDX is twice present there.

In ssl_dataset.py  by saving self.get_image_paths(), like suggested by you save_file(self.get_image_paths(), "/path/to/labels.json"), keeps on running the program infinitely.

What I observed that def get_image_paths(self): from ssl_dataset has the information of datapaths but not in the order in which they are being called.

Regards,
DC

@DC95 Can you post the config you are training + your dataset catalog + the code you are using to save the cluster assignments + indexes above.
#2 -> Can you be more specific. What do you mean by this?
#3 -> You need to call this only once. You can use something like self.saved_results
#4 -> Yes that is correct. I would recommend saving the assignment indexes, not in the order in which they are called, but instead based on inputs["data_idx"]. e.g. here: https://github.com/facebookresearch/vissl/blob/master/vissl/losses/deepclusterv2_loss.py#L117

Hi @iseessel,
I am posting the files asked by you

JSON file, YAML file, .py file can't be uploaded here that's why I am attaching in txt format.
I am doing some changes in the deep cluster_v2 loss to have the assignment and the indexes dumped.
Like in deepclusterv2_loss.py changed part is shown like this -

#################################
changed code
##################################

can't be posted here so attaching txt version

More explanation about point 2 from above post -
If I save the idx values from for a run of only 1 epoch-
image_path = self.image_dataset[idx]  save_file(idx,"/p/project/deepacf/kiste/DC/juelich_2x85_128x128_15k/checkpoints_train_400ep_exp/disk_dataset_getitem_idx1.json")
Then let's say I have a training image dataset of 15077 I am getting more than 15077 idx values
dcv2_2x85_rnet_128x128_Juelich.txt
deepclusterv2_loss.txt
dataset_catalog.txt
Regards,
DC
.

Thanks for the info @DC95!
I was able to get my hands dirty and this is what I found that works -- check this commit: https://github.com/iseessel/vissl/commit/da35a50113feb16884e9a87d72e4ebb27a4bd75d
The indexes of samples.npy should match the indexes of the assignments.
Re:
One more thing interesting is that I looked at the IDX values getting called in def getitem() of disk_dataset.py. It is storing IDX values almost twice the number of training size, each IDX is twice present there.

This should not be happening and I was unable to repro it with a test dataset of 100 train and test images. For this:

Can you please verify the number of images in your folder: /p/project/deepacf/kiste/DC/dataset/hope2013_128x128_image/train_juelich_128x128_15k.
Can you run your config with my above commit and verify the indexes are indeed above what's expected.
If 1/2 still fail, can you send the output of samples.npy.

Dear @iseessel
Thanks for jumping into the mud. I agree that the commit works nicely specially the linesave_file(self.image_dataset.samples, "/private/home/iseessel/samples.npy") .
I am attaching the output sample. npy in zip
samples.zip
I have one thing to ask -

if I see the positional order in which images names are present in sample .npy. Do they correspond to the same index order appearing in indexes_all from deepcluster_v2?
I think the answer is yes, but just asking.

I will send more analysis of this by tomorrow or Monday.
I am also attaching the assignment and indexes in zip.
assignment_indexes.zip
.

Yep you are right -- they do match!

Well, then the journey of finding image_names, indexes, and assignments comes to an end, I see. Thanks, @iseessel, very much for the constant support.
Cheers,
DC

feel free to open back up if any probs!


why the code doesnot release memory after Validation?

@xinntao Hi, when the code do its first Validation, it will allocate about 2GB GPU memory, but do not release them after Validation.

Did you mean the memory is not freed after the validation is over?

@xinntao Yes, when the second validation begin, the gpu memory  occupation does not increase.


Fix #5542 UI : Table Query Card Is Not Expandable

Describe your changes :

I worked on #5542

Type of change :

[x] Bug fix

Frontend Preview (Screenshots) :
https://user-images.githubusercontent.com/59080942/174724095-137516db-19b7-42cc-b85e-16924d07bdf3.mov

Checklist:

[x] I have read the CONTRIBUTING document.
[x] I have commented on my code, particularly in hard-to-understand areas.
[ ] I have added tests that prove my fix is effective or that my feature works.
[x] All new and existing tests passed.

Reviewers
@open-metadata/ui

@Sachin-chaurasiya we have enough white space in this tab, so by default instead of showing just 2 lines, should we show like 5 to 7 lines and keep the expand-collapse button for anyone to view it entirely?

@Sachin-chaurasiya we have enough white space in this tab, so by default instead of showing just 2 lines, should we show like 5 to 7 lines and keep the expand-collapse button for anyone to view it entirely?

@shahsank3t, We show those 2 lines based on height, to show more lines, will need to increase the height.
But if we have only 2 lines of query then it will just show 2 lines and empty space below that.


Customize tag field "_tag"

Hey 👋
Thanks for creating this awesome library.
Is it possible to change the name of the tag field for JSON codecs?
I want to use a different name for the field and not "_tag". It's not a hard blocker but just wanted to check if there is a configuration option that supports this.

Hey @baranyildirim. I would be open to a feature making this possible. I am not sure when I would get around to it personally. PR welcome once an API design is agreed upon.


A11y_AzureDataStudio(Schema,Dacpac,Backup)_Update Target pop up_AI4D: Name of the "Image" is not correct i.e. "Maininstruction".

“Check out Accessibility Insights! - Identify accessibility bugs before check-in and make bug fixing faster and easier.”
#A11yMAS; #A11yTCS; #A11y_ADS_Schema_Dacpac_Backup; #Azure Data Studio; #DesktopApp; #Win10; #AI4D; #MAS4.1.2; #MAS1.3.1;
Environment Details:
Application Name: Azure Data Studio
Application Version: 1.9.0 (user setup)
Commit: 78a42e1
Electron: 3.1.8
Node.js: 10.2.0
V8: 6.6.346.32
OS: Windows_NT x64 10.0.18362
Additional Details :
Tools: AI4D.
Mas reference: MAS 4.1.2, MAS1.3.1
Repro Steps:

Launch Azure Data Studio application.
Connect to server with windows credentials.
Navigate to Extensions from left menu.
Search & install Schema Compare extension.
Navigate to Connections from left menu.
Expand the server connected in step 2.
Right click an on prem database and select Schema compare from Context menu.
Navigate till Select Source or Select Target & hit enter.
Provide all the details for Source & Target. In target select any database.
Navigate till Ok button & hit enter.
Navigate till Compare menu from Schema compare Menu bar & hit enter.
Navigate till Apply button from Schema Compare Menu bar & hit enter.
Update Target pop up will appear
Open AI4D and check the name of the image ""Main instruction".

Actual:
Name of the "Image" is not correct i.e. "Main instruction".
Expected:
Name of the "Image" should be provided as "Warning icon".
Recommendations:
Refer below link which is repository of bug fixes code snippets: https://microsoft.sharepoint.com/teams/msenable/mas/pages/browse-fixes.aspx
User Impact:
Screenreader user will receive wrong information about the image.
MAS Reference:
MAS 4.1.2 - https://microsoft.sharepoint.com/:w:/r/teams/msenable/_layouts/15/WopiFrame.aspx?sourcedoc={248054a6-5e68-4771-9e1e-242fb5025730}
MAS1.3.1-https://microsoft.sharepoint.com/teams/msenable/_layouts/15/WopiFrame.aspx?sourcedoc={54f28d1f-a2d1-4dcd-84e1-5c9b87e8aba4}
Attachment for Reference:

Edited typo in original comment: "Waring icon" --> "Warning icon"

Upstream bug.  Filed as https://github.com/microsoft/vscode/issues/79072

Update: upstream even of vscode.  Filed to Election as https://github.com/electron/electron/issues/19784

Marking this for Exclusion. As stated above, this is an upstream issue with Electron and is being tracked here: https://github.com/electron/electron/issues/19784.
Importance of Experience: minimal
Warning popups may appear in scenarios where we want to guarantee that the user's previous action was intended. In this case, it was to ensure they want to 'Apply' changes to a Target database, which would overwrite any existing data. These warning scenarios occur infrequently.
Quality of Experience: not impacted
Users can receive the full context of the popup through its text contents. The context of the Warning Icon image is not necessary to understand the popup's purpose.
AAT Conformance Doc: https://cela-ra-aat-prod.azurewebsites.net/#/workflow/ee5c9007-47f4-4fcb-a4d7-a998a617edde?tab=default
@fsteffi, please work with a SME to review.

Unfortunately this seems to be an issue with the TaskDialogIndirect Windows API, that Electron uses to implement dialog.showMessageBox(). It cannot be fixed without significant effort of re-implementing the Electron API in a different way.

Closing as upstream

Approved as non blocking.


If I run on different versions of Android phone, I get different chrome version in userAgent?

I read the description in the readme that the library replaces the built-in webview, but it doesn't seem to replace the android built-in webview on different versions of Android phones, as I got a different version of chrome.
I'm a little confused, does the replacement of built-in webview refer to the react-native built-in webview component or to the Android built-in webview?
When I package the apk file, the apk that introduces the react-native-webview component is almost the same size as the apk file that doesn't introduce the react-native-webview component, so can I assume that the component doesn't contain the chrome kernel, but uses the android system's built-in webview?

I searched for other issues and found that react-native-webview is dependent on the Android has a built-in webview. so if the version of Android is lower and the user Without updating the Android webview, then react-native-weview would be Versions that are older, then there is no guarantee that the web page will render consistently on all devices.
Is there a way to embed the chrome kernel in a react native project?

Yeah, I consider this issue is so important and urgent!
Hi, RN team.
Please give us the best solutions!
@LuHugo Did you try to implement custom webview ?
http://reactnative.dev/docs/custom-webview-android

@kingofdevs  Thank you for the reply. I'm just a front-end developer with close to zero skills in native development, and I don't know OC or Swift languages at all, so I'm Don't think I'm up to it.

Please try this one.
https://medium.com/lazy-engineering/creating-an-embedded-browser-with-react-native-aea42b54740

@kingofdevs Thanks for sharing, I read it and realized it's not really embedded in the chromium kernel but still depends on the Android version. I'd like to get a full embed on Android that doesn't depend on the Android version chromium kernel webview. no easy way to do this so far, just prompting the user to upgrade. version of Android webview, but this is very annoying.

@LuHugo  Did you find any other solution?

Did someone find a solution for this? Im building a react native app with a webview screen, but i got some errors on the website beacuse the old version of the browser.

@angelop11 I didn't find an easy solution, we just stopped being compatible with lower versions of Android.


Wildcard Commands

Hi There,
Thanks for the great library in the first place. Would you consider adding wildcard commands such as:
/dl_12351

Such commands exist in @music bot and is useful for bots that allows action on inline query answers.

Hi!
I think you can use $.waitForRequest method for this. I mean you can send the message with this commands and wait for the next message from user with command

@Naltox - 👍 seems to work for now, thanks!


How to pass value from search box to load data in grid?

Hi All,
I'm not very familiar in type script, what i want to do is when i open the
link of students records there's no data will show until they will input there Student Number in
the search box and trigger the loading of data using the Search Button.
Any possible solution is very much appreciated. thanks!
see screenshot..

Ok.. i tried to set a default value if i can load the data to grid.
and it works, my problem is how to trigger it using the search button and reload/refresh the grid.
this is the code i put.
I put this in StudentGrid.ts
protected onViewSubmit() {
if (!super.onViewSubmit()) {
return false;
}
var request = this.view.params as Serenity.ListRequest;
request.Criteria = Serenity.Criteria.and(request.Criteria, [['StudNo'], '=',
$('#StudentNo').val()]);
return true;
}
I put this in StudentsIndex.cshtml
div class="box">

        @Html.TextBox("StudentNo", "S1218-0005", new { @class = "form-control", @placeholder = "Enter Student No" })

            <button type="button" class="btn btn-info btn-primary" id="btnSearch">SEARCH</button>

`

Hi @volkanceylan!
i hope you can help me with this, any possible solution or
not exactly the same with my sample above. thanks!

You should return false from onViewSubmit or getGridCanLoad while the student no is empty

Thanks @volkanceylan ! I'm quite busy for other projects that i forgot to close this issue.
I changed the condition above and just use the builtin search box.
I need to study javascript/typescript to better understand serenity, i'm more on back end side. :)
I'm getting to love this serenity platform, i hope more updates are coming and
thanks for this awesome platform that makes my work very easy, i can focus more in business side.
here is the code i used, the same above i just change the parameter.
  protected onViewSubmit(): boolean {             if (!super.onViewSubmit()) {                 return false;             }             let request = this.view.params as Serenity.ListRequest;             request.Criteria = Serenity.Criteria.and(request.Criteria, [[fld.StudNo], '=', request.ContainsText]);             return true;         }


added Green effect

Not unique enough, the effect is just the green channel, instead of this effect you can make something to simulate different types of color blindness.


Improve GSON JSON handler, moving Key specific logic

Pull Request
Related issue
Fixes #487
What does this PR do?

Removes Key specific logic from GsonJsonHandler in favour of creating a type adapter for serializing and deserializing Key
Removes a constructor in GsonJsonHandler which seemingly is only used for testing (a spy was created in one of the unit tests, recording actions taken - this unit test has been updated). This specific constructor allowed a Gson instance to be passed in, which would allow bypassing the addition of the type adapter, which would break the Key specific functionality just added.
Depending on how you view this, it could be seen as a breaking change, if you consider the GsonJsonHandler to be part of the public API. However, I would argue that it should not be and I don't see another way (though I may well be wrong) to feasibly move the Key logic out of this class.
Moved the @Setter annotation on Key to class level, which results in a setter being generated for every field. Previously, setters were only generated for some fields. If this is a problem, then I think the way to get around this is to use reflection to set fields in the type adapter. This is less ideal but it's possible to do. I believe the Gson library itself (Jackson too) uses reflection to set fields anyway. I am happy to make this change and roll back the changes made to Key if this is preferable.
Added many more unit tests to GsonJsonHandlerTest related to encoding/decoding Key, and updates some earlier tests. These tests were added to compare the existing functionality (before my changes - with the Key specific logic still in place) with the changes that I have made, to ensure that they are compatible and that there are no differences/breakages. These tests could theoretically be committed first and they should pass against the GsonJsonHandler as it is now (before this PR).

PR checklist
Please check if your PR fulfills the following requirements:

[x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
[x] Have you read the contributing guidelines?
[x] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!

thank you @jrhenderson1988 🙏
bors merge


ImportError: libmpich.so.12: cannot open shared object file: No such file or directory

System information

OS : Ubuntu 17.10
**TensorFlow installed from **: source
TensorFlow version (use command below): r1.3
Python version: 3.6
CUDA/cuDNN version: 8.0/ 6

When I try to import tensorflow, I get error:
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/__init__.py", line 24, in <module>
    from tensorflow.python import *
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/python/__init__.py", line 49, in <module>
    from tensorflow.python import pywrap_tensorflow
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow.py", line 52, in <module>
    raise ImportError(msg)
ImportError: Traceback (most recent call last):
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow.py", line 41, in <module>
    from tensorflow.python.pywrap_tensorflow_internal import *
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 28, in <module>
    _pywrap_tensorflow_internal = swig_import_helper()
  File "/home/jihao/anaconda3/lib/python3.6/site-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 24, in swig_import_helper
    _mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)
  File "/home/jihao/anaconda3/lib/python3.6/imp.py", line 242, in load_module
    return load_dynamic(name, filename, file)
  File "/home/jihao/anaconda3/lib/python3.6/imp.py", line 342, in load_dynamic
    return _load(spec)
ImportError: libmpich.so.12: cannot open shared object file: No such file or directory

I try to fix it by command
sudo apt install libmpich-dev

It did not work.

Try searching for and installing other libmpich packages?

Already installed.
I tried find which package contains that file and got nothing.

Unfortunately we can't help too much with environment problems here. Try asking on  StackOverflow.


Fix require for polyfill

Webpack gave an error: Cannot resolve module 'babel/polyfill'

I just found out that both ways work. The exiting is better, therefore closing. Babel's npm is confusing.


[Event Request] Codeunit 6620 "Copy Document Mgt."

I would like kindly ask you to create an Integration event in Codeunit 6620 "Copy Document Mgt.", in procedure "CopySalesDocUpdateHeader".
local procedure CopySalesDocUpdateHeader(FromDocType: Enum "Sales Document Type From"; FromDocNo: Code[20]; var ToSalesHeader: Record "Sales Header"; FromSalesHeader: Record "Sales Header"; FromSalesShptHeader: Record "Sales Shipment Header"; FromSalesInvHeader: Record "Sales Invoice Header"; FromReturnRcptHeader: Record "Return Receipt Header"; FromSalesCrMemoHeader: Record "Sales Cr.Memo Header"; FromSalesHeaderArchive: Record "Sales Header Archive"; var ReleaseDocument: Boolean);
var
OldSalesHeader: Record "Sales Header";
begin
with ToSalesHeader do begin
CheckCustomer(FromSalesHeader, ToSalesHeader);
OldSalesHeader := ToSalesHeader;
OnBeforeCopySalesHeaderDone(ToSalesHeader, FromSalesHeader);
// >>>
OnBeforeCopySalesHeader(FromDocType, ToSalesHeader, OldSalesHeader, FromSalesHeader, FromSalesShipmentHeader, FromSalesInvoiceHeader, FromReturnReceiptHeader, FromSalesCrMemoHeader, FromSalesHeaderArchive)
// <<<
case FromDocType of
....
end;
Event signature:
[IntegrationEvent(false, false)]
local procedure OnBeforeCopySalesHeader(FromDocType: Enum "Sales Document Type From"; var ToSalesHeader: Record "Sales Header"; OldSalesHeader: Record "Sales Header"; FromSalesHeader: Record "Sales Header"; FromSalesShipmentHeader: Record "Sales Shipment Header"; FromSalesInvoiceHeader: Record "Sales Invoice Header"; FromReturnReceiptHeader: Record "Return Receipt Header"; FromSalesCrMemoHeader: Record "Sales Cr.Memo Header"; FromSalesHeaderArchive: Record "Sales Header Archive")
begin
end;
In our extension, we need it because we would like to get set extra data "from documents" to a ToSalesHeader, which has to be set before "Sell-to Customer No." validation.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 41650.


[Feature Request] Clear Cache on Reboot

The ability to go into local admin and check the "Clear Cache on Save" fixes most of our issues... but it sure would be nice if we could remotely reboot the Chromeboxes with the admin console, and have the cache clear as well.

Forgot I already requested this in #282


Missing commas in JSON snippets

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

biztalk/core/feature-pack-add-application-project.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

@zevanreg Good catch. Thank you!


Show link to external job, if present

Features
This update accepts linkToVendorTask as an additional detail returned with a TranslationTask, which should be a link to view the current translation task on the vendor's platform.
If there is a translation task and it includes linkToVendorTask, then a link to "View Job" will show in the translation tab so users can easily get to the job on the translation vendor platform to perform  additional tasks or get additional info.
With task present, and link returned with task (shows next to "Refresh" button):

With no task (or no link):

Fixes
Resolves Z-index issue when opening the "Inspect" view, which is still available for translations tab but was showing behind the translations tab content. Removing zOffset resolved the issue and couldn't find any new issues introduced in the tab by removing that setting.

@cngonzalez I'm not sure why it shows all of the past commits that have already been added. Previously, I merged into my forked repo's main branch first then created a pr into Sanity's repo from there, but this time I figured I could try adding here directly from my feature branch. Not sure why that would matter though 🤔 I did have issues fetching the updates from here into my fork, so maybe doing rebasing or something along the way messed that up. Let me know if that's a problem--I don't mean to muck up the commit history!


10 Loops

Now that we have conditional handling, we can finally work on loops.
We start by detecting WHILE, REPEAT, and FOR statements in statement():
https://github.com/nyjc-computing/pseudo/blob/cabcf32df001bf023792673c8cc2344829990cab/parser.py#L218-L223

Before we implement the parsing functions whileStmt, repeatStmt, and forStmt, let's think about what kind of stmt we should return.
WHILE
WHILE statements are written as follows:
WHILE <condition> DO
    <statements>
ENDWHILE

REPEAT
REPEAT statements are written as follows:
REPEAT
    <Statements>
UNTIL <condition>

FOR
FOR statements are written as follows:
FOR <identifier> <- <value1> TO <value2>
    <statements>
ENDFOR

or
FOR <identifier> <- <value1> TO <value2> STEP <increment>
<statements>
ENDFOR

What they share in common:

They have a condition that is evaluated at the start/end of each iteration
They have a list of statements to be executed while a particular condition evaluates to TRUE

What they do differently:

WHILE evaluates the condition first, then executes the statements
REPEAT executes the statements first, then evaluates the condition
FOR constructs a range iterator, and checks that the counter is not greater than the range upper limit

Representing loops
Let's represent all three with the following stmt format:
{
    'rule': 'while' | | 'repeat' | 'for',
    'cond': <name> | <expr>,
    'stmts': [<statements>],

Parsing WHILE and REPEAT
WHILE statement:
https://github.com/nyjc-computing/pseudo/blob/54d18c65e55729252cea68175e77daaa2c0ee1ac/parser.py#L200-L215
REPEAT statement:
https://github.com/nyjc-computing/pseudo/blob/54d18c65e55729252cea68175e77daaa2c0ee1ac/parser.py#L217-L231
These are relatively straightforward, if a little tedious.

Desugaring FOR
Instead of making a new type of stmt for FOR statements, we can reuse the existing structure. Although a FOR loop can be rewritten into a WHILE loop, the FOR loop is generally easier to read. Such ease-of-use features in a programming language are often called syntactic sugar because they make a programming language "sweeter"/easier to use.
When we parse FOR statements, instead of adding more complexity to our interpreter by making a new type of stmt, we can instead create them as existing 'while' stmts, in a process known as desugaring.
A FOR loop like this:
FOR <identifier> <- <value1> TO <value2> STEP <increment>
    <statements>
ENDFOR

gets desugared to:
<identifier> <- <value1>
WHILE <identifier> <= <value2> DO
    <statements>
    <identifier> <- <identifier> + <increment>
ENDWHILE

Parsing FOR loops
We capture parts of the FOR loop as follows:
https://github.com/nyjc-computing/pseudo/blob/7fb0f23fbdd122182f397846fac64b388270054b/parser.py#L233-L251
We generate the init statement, reusing as much of our parsing machinery as we can:
https://github.com/nyjc-computing/pseudo/blob/7fb0f23fbdd122182f397846fac64b388270054b/parser.py#L252-L258
Likewise for the loop cond:
https://github.com/nyjc-computing/pseudo/blob/7fb0f23fbdd122182f397846fac64b388270054b/parser.py#L259-L265
And then the increment at the end of each iteration of statements:
https://github.com/nyjc-computing/pseudo/blob/7fb0f23fbdd122182f397846fac64b388270054b/parser.py#L266-L274
Finally we construct the FOR loop as a 'while' stmt:
https://github.com/nyjc-computing/pseudo/blob/7fb0f23fbdd122182f397846fac64b388270054b/parser.py#L275-L280
This is ugly and complicated, because we are constructing tokens in a module that shouldn't have to know how that is done. We will attempt to clean this up in a future refactoring.

Testing
We add some test pseudocode to check our parser:
https://github.com/nyjc-computing/pseudo/blob/0207e4870bd3e10950fdf05aa9b3e7b92bd6562c/main.py#L11-L33
And fix a few bugs in our loop parsers:
[0207e4870bd3e10950fdf05aa9b3e7b92bd6562c]

Resolving loop statements
In a slight twist from the previous chapter/pull request, we do resolving first before interpreting.
Our decision to desugar and use a common stmt structure bears fruit almost immediately: we only need one verifier for all three types of statements:
https://github.com/nyjc-computing/pseudo/blob/fca150c08f28bfff3ce4c21d0a83879b32bff42c/resolver.py#L87-L88
No 'for' statement handling needed, since a FOR loop is desugared to a 'while' statement.
Recall that the resolver only needs to resolve each expression/statement once, to ensure that types match up and to insert a frame for each get expr.
And then we follow the code examples in the rest of resolver.py to verify() the stmt['init'] (if there's one), resolve() the stmt['cond'], and again verify() each statement in stmt['stmts']:
https://github.com/nyjc-computing/pseudo/blob/396a9e1960fcd8f5357701710346b814db1cef8c/resolver.py#L73-L79

Interpreting loop statements
The execution is much more straightforward than the parsing:
WHILE statements
https://github.com/nyjc-computing/pseudo/blob/24e4b0438fd844bb53155a37c34f221f11d0f701/interpreter.py#L50-L55
REPEAT statements
https://github.com/nyjc-computing/pseudo/blob/24e4b0438fd844bb53155a37c34f221f11d0f701/interpreter.py#L57-L62
We are not expecting any init for REPEAT statements, so we can skip that. And instead of evaluate()ing cond for True, we keep running stmts until cond evaluate()s to False.

And now we have working loops! We'll catch the detailed bugs later, at least our simple test code runs as expected.


[Bug report]: Incorrect Proposal overview

Platform
Desktop
Version
Alpha 4
Description
2 Issues here.
Issue 1:
I voted on proposals. TX are confirmed and show up in explorer and history
Opening the Wallet, logging in and looking in Governance does not show me that i vote on proposals:
Those are my votes

This is the governance overview:

It takes around 2 - 3 minutes until this view changes and shows the actual participation

Issues 2:
The Proposal count is wrong:
Here it says Total proposals 8, while i have only uploaded 7 to this Wallet, i have uploaded 8 to the other wallet. If Wallets are really separated it should be enforced also in this overview

Expected behaviour
faster loading, correct display of the count
Actual behaviour
--
Can the issue reliably be reproduced?
Yes
Steps to reproduce the issue
No response
Operating System
Windows
Diagnostics
--

Developer Profile
Yes
Profile Type
Software (Stronghold)
Staking
None
Crash Status
None of the above
Error Messages
--
Error Logs
--

Duplicate declaration

[X] I have searched the issues tracker this issue and there is none

Code of Conduct

[X] I agree to follow this project's Code of Conduct

May be fixed by https://github.com/iotaledger/firefly/issues/5784

Should be fixed with the new wallet.rs release, we'll keep it open just in case it resurfaces.

Due to the latest refactors, I'll close this, since we fixed the correct display of the counts and optimized loading speeds.


1.0 release? and development roadmap?

i see that this project is on 0.n since 2014. is it feature complete and bug free?
how reliable is it to use on commercial projects?
are there plans for a 1.0 release? if not, is there a better alternative in 2018.
many thanks

i see that this project is on 0.n since 2014. is it feature complete and bug free?

We split up this repository into a repository per component and worked in those repositories on each component. How ever we are working on updating this meta package.

how reliable is it to use on commercial projects?

It's used by countless business around the world across in a huge variety of projects.

are there plans for a 1.0 release?

We are working on it, however we recommend using components directly rather then using this meta package.

many thanks. do you have any proposed dates for 1.0 release? what will this signify in terms of testing and reliability?


Update requirements.txt

#128
To latest miflora (0.7.1) and btlewrap (0.0.10).

Tested and can assure it works.

@ThomDietrich merge please?

@ThomDietrich merge please?

Jesus, @ThomDietrich PLEASE merge :)

Thanks for the push. Really sorry I didn't react earlier. Pretty busy atm and not happy what that does to my open source engagement :(

Thank you for sharing your project!


Tiktok Pixel Helper does not detect my pixel

I installed my Tiktok pixel more than a month ago using Google Tag Manager on the web but the Pixel Helper doesn't pick it up although inside TIktok we can see that events are received. I've tried everything and it doesn't pick it up, why is that?

Hi, I am sorry for the problems you run into, but we are only the code maintainer of Google Tag Manager template itself.
To get better support from our dedicated support team, please submit a ticket here


NXP: Add LPCXpresso55S16 EVK board support

This PR add initial support for the NXP LPC55S16 SoC and the LPCXpresso55S16 development board.
A few notes:

Only non-secure access is supported for now
pyOCD does not yet support the LPC55S16, so J-Link firmware must be flashed to the LINK2 on-board debugger
The LINK2 UART TX/Flexcomm0 RX seems a bit fragile, sometimes a character is misinterpreted (but only on RX, never on TX). When using an external USB TTL UART connected to JP3, there are no issues.

@galak please review

Looks good, one question about how we "enable" HAS_MCUX_IAP. And would like to run the board image through https://imagecompressor.com/ to reduce the file size.
Otherwise LGTM.

Thanks. I have compressed the image further, reduced file size by ~23%.


Range, Interval and variable interpolation aren't supported anymore

After upgrading to grafana 7 and plugin version 7 our queries:
import "regexp"

from(bucket: "my-bucket")
  |> range($range)
  |> filter(fn: (r) =>
    r._measurement == "metric" ... other conditions
  )
  |> aggregateWindow(every: $__interval, fn: mean)

don't work anymore because the $range and $__interval variables aren't replaced anymore so the query fails with:
invalid: compilation failed: loc 4:12-4:18: unexpected token for property key: ILLEGAL ("$")`

I've also seen that before a condition like this:
regexp.matchRegexpString(r: /^($some_variable)$/, v: r._field)

where some_variable has multiple selections would be converted properly to a regex (e.g. (value1|value2) as per https://grafana.com/docs/grafana/latest/variables/templates-and-variables/#formatting-multiple-values) but now it just stays as {value1,value2} so the regex doesn't work anymore

For anyone having the same issue the workaround is this:
import "regexp"

from(bucket: "my-bucket")
  |> range(start: v.timeRangeStart, stop: v.timeRangeStop)
  |> filter(fn: (r) =>
    r._measurement == "metric"
    and r.machine == "$machine"
    and regexp.matchRegexpString(r: /^${variable_1:regex}$/, v: r._field)
  )
  |> aggregateWindow(every: v.windowPeriod, fn: mean)

@alex88, Thanks for reporting this! Yes, this was intentional, although it makes sense to have things backward compatible, the idea was to be able to copy and paste from the influx query editor, and have the queries work.
Would you like to see the "$range" variable return? Or is the workaround you have found reasonable for your use case?

@srclosson oh sorry I didn't know this was the intended direction, I've read about the fact that you can copy paste from the editor in the changelog and that's where I've found the workaround.
Since the workaround works and I haven't found any other blocking issue I think there's no reason to support the old variables as long as it's documented and there is a proper way to handle the old use cases (e.g. the variable regex interpolation).
I'll close this issue for now but if you think something still needs to be done please reopen it.
Also I'd like to point out that the sample queries return some syntax errors


Which Seurat data slot to use for input count matrix?

Dear Maria,
I'd like to run the Community analysis on a group of 20 samples (8 control, 12 tumor). I have the data in the form of a Seurat object so I am just wondering which data slot is the most suitable to use as the input count matrix. I can have the log-normalised scaled counts or the “integrated” counts (as a results of the following pipeline https://satijalab.org/seurat/articles/integration_introduction.html).
Which one do you think is the best for your tool?
Thanks,
Verena

Hi Verena,
Great that you are using the tool!
We usually use the "normal" normalised counts (i.e. not log-transformed), but I think you can also use the log-norm counts -- you would just need to double check where you put the threshold_expr which sets up the minimum expression in a cell that you regard as meaningful (everything below that will be set to zero).
We also tried it on the integrated counts. I am not sure what method Seurat is using in the background, we used scGen, which integrated well, BUT allowed negative counts. I personally about allowing counts to be negative because it gives artefacts in community when calculating the mean expression in a cell type. But if the batch effect is very big -- then you probably have no choice. In the end, these artefact most probably will rather affect some lowly expressed genes, in my opinion, so from two evils, you'd choose the least :-)
Best,
Maria


pikchr support

pikchr is a simple markup language for creating graphical diagrams with a nice standalone program to render.  It'd be useful to have support for inline pikchr documents in Pandoc.
Here's a diff (as of c40210b658db9f0f958c0b6c280507fc8d7de46b) that implements that:
diff --git a/diagram-generator/README.md b/diagram-generator/README.md
index d04e204..97e00ae 100644
--- a/diagram-generator/README.md
+++ b/diagram-generator/README.md
@@ -11,6 +11,10 @@ To be able to use this Lua filter, the respective external tools must be
 installed. However, it is sufficient if the tools to be used are installed.
 If you only want to use PlantUML, you don't need LaTeX or Python, etc.

+### Pikchr
+To use pikchr, you must install pikchr itself. See the
+[pikchr website](http://pikchr.org/) for more details.
+
 ### PlantUML
 To use PlantUML, you must install PlantUML itself. See the
 [PlantUML website](http://plantuml.com/) for more details. It should be
@@ -233,6 +237,7 @@ pandoc.exe README.md -f markdown -t docx --self-contained --standalone --lua-fil

 All available environment variables:

+- `PIKCHR` e.g. `c:\bin\pikchr.exe`; Default: `pikchr`
 - `PLANTUML` e.g. `c:\ProgramData\chocolatey\lib\plantuml\tools\plantuml.jar`; Default: `plantuml.jar`
 - `INKSCAPE` e.g. `c:\Program Files\Inkscape\inkscape.exe`; Default: `inkscape`
 - `PYTHON` e.g. `c:\ProgramData\Anaconda3\python.exe`; Default: n/a
@@ -243,6 +248,7 @@ All available environment variables:

 All available meta keys:

+- `pikchrPath`
 - `plantumlPath`
 - `inkscapePath`
 - `pythonPath`
diff --git a/diagram-generator/diagram-generator.lua b/diagram-generator/diagram-generator.lua
index 19e36bc..7e0bbcc 100644
--- a/diagram-generator/diagram-generator.lua
+++ b/diagram-generator/diagram-generator.lua
@@ -22,6 +22,12 @@ end
 local with_temporary_directory = system.with_temporary_directory
 local with_working_directory = system.with_working_directory

+-- The pikchr path. If set, uses the environment variable PIKCHR or the
+-- value "pikchr" (local pikchr version). In order to define a
+-- pikchr version per pandoc document, use the meta data to define the key
+-- "pikchr_path".
+local pikchr_path = os.getenv("PIKCHR") or "pikchr"
+
 -- The PlantUML path. If set, uses the environment variable PLANTUML or the
 -- value "plantuml.jar" (local PlantUML version). In order to define a
 -- PlantUML version per pandoc document, use the meta data to define the key
@@ -85,6 +91,9 @@ end
 -- meta options was set, it gets used instead of the corresponding
 -- environment variable:
 function Meta(meta)
+  pikchr_path = stringify(
+    meta.pikchr_path or meta.pikchrPath or pikchr_path
+  )
   plantuml_path = stringify(
     meta.plantuml_path or meta.plantumlPath or plantuml_path
   )
@@ -111,6 +120,11 @@ function Meta(meta)
   )
 end

+-- Call pikchr with some parameters.
+local function pikchr(code, filetype)
+  return pandoc.pipe(pikchr_path, {"--svg-only", "-"}, code)
+end
+
 -- Call plantuml.jar with some parameters (cf. PlantUML help):
 local function plantuml(puml, filetype)
   return pandoc.pipe(
@@ -303,6 +317,7 @@ end
 function CodeBlock(block)
   -- Using a table with all known generators i.e. converters:
   local converters = {
+    pikchr = pikchr,
     plantuml = plantuml,
     graphviz = graphviz,
     tikz = tikz2image,

I've moved the diagram generator to https://github.com/pandoc-ext/diagram and am maintaining it there. I'm closing the issue here, but please do feel free to re-raise it in the new repo.
I decided to wait with pikchr support simply because I want to test all generators in CI and it isn't in the official repos of either Ubuntu or Alpine Linux. I'm open to adding it if someone wants to provide the necessary installation routine.
Note: there's also https://code.jboy.space/pikchr-filter/dir?ci=tip.
Closing this here.


Toggle Linter

is there a way to disable linter temporarily quickly via command palette?

+1.
Sometimes when you're refactoring code it can be annoying those pop-ups. So I'd like to see if it can be globally enabled disabled via a shortcut or command palette

:+1:

What the command to toggle linter?

@bluescreen10 there isn't. Also if you want to disable linter temporarily, just disable it from settings menu. The latest version cleans everything up on deactivate so you shouldn't have any problems.

All issues were closed because we switched to a rewrite of the linter. This is still a valid request and one that I'd like to have too.
I'm reopening it so maybe we'll get it done in the new linter. There will need to be some planning to figure out exactly how it should work. I think it should just disable for the current Editor, but I expect some disagreement. Disabling the linter from the settings panel is not really a solution for ignoring a file or a few files.

@AsaAyers would the latest change to allow toggling of panel be enough? or you want to disable the all the features of it?

I'd want an option to go a step further and not even lint the current editor. I don't think it even needs a button, but a command that would cause it to clear all errors in the current editor and then never attempt linting again would solve the issue.
I don't think it should be something that persists. If you triggered it by mistake or change your mind you should be able to just close the tab and re-open the file.

@AsaAyers a whole map just appeared in my mind on how to implement this, so I think I'll do this one right after that click-to-jump feature.


CATHY breaks due to positive surface pressure heads after DA update

Problem description
The simulation consists in an infiltration in a confined domain (no flux on all the side boundaries). During DA update, after 3hours of infiltration, the state update generates a positive small value of pressure head (1e-3).  CATHY breaks (the initial conditions being wrong) and the DA stops.
Simulation parameters

Pressure head initial: -5
Constant and uniform atmbc: 5e-7
no input of ponding head initial conditions
analysis method: Data Assimilation

Running the same, but decreasing atmbc to 5e-8 solved the issue.

[ ] Implement a user warning for positive surface pressure head during DA update if no pounding is set.


Rename swagger::thing

swagger::thing is a fairly large file and could use a more descriptive name

It's a debug file that somehow made it to the main branch, I've just deleted it, thanks for noticing!


Shouldn't type DeepSignalObject be exported?

I'm attempting to create a store using deepsignal in TypeScript.
I'm having a problem when I attempt to type my store, and in particular my Store's state object. Don't I need to declare state as a type of DeepSignalObject? But that type is not exported from the library.
interface AuthState {
  auth: boolean;
}

interface AuthActions {
  isAuthenticated: () => boolean;
  setIsAuthenticated: (isAuthenticated: boolean) => void;
  signOut: () => void;
}

interface DeepAuthState {
  state: DeepSignalObject<AuthState>;
}

type AuthStore = DeepAuthState & AuthActions;

export const authStore: AuthStore = {
  state: deepSignal<AuthState>({
    auth: false,
  }),

  isAuthenticated() {
    return this.state.auth;
  },

  setIsAuthenticated(isAuthenticated: boolean): void {
    this.state.auth.value = isAuthenticated;
  },

  signOut(): void {
    setIsAuthenticated(false);
  },
};

Just use the DeepSignal type:
import { deepSignal, DeepSignal } from "deepsignal";

interface AuthState {
  auth: boolean;
}

interface AuthActions {
  isAuthenticated: () => boolean;
  setIsAuthenticated: (isAuthenticated: boolean) => void;
  signOut: () => void;
}

interface DeepAuthState {
  state: DeepSignal<AuthState>; // Use the DeepSignal type
}

type AuthStore = DeepAuthState & AuthActions;

export const authStore: AuthStore = {
  state: deepSignal<AuthState>({
    auth: false,
  }),

  isAuthenticated() {
    return this.state.auth;
  },

  setIsAuthenticated(isAuthenticated: boolean): void {
    this.state.auth = isAuthenticated; // Don't use .value here, just mutate the object prop
  },

  signOut(): void {
    this.setIsAuthenticated(false);
  },
};

Thanks for that (and cleaning up my wrappering of my store's methods with deepSignal())

No problem 🙂

I've improved the docs to explain how DeepSignal works: https://github.com/luisherranz/deepsignal/commit/bf1bae2c74bce112ee994a4faa23865614b4c90b


Publisher name might be incorrect for Gather extension

Looks like it's listing ms-python not Microsoft. Might be changed when we publish? But if not we should look into this as it looks non-official microsoft.

its fixed now that we published it


[core] Specs: Market matching

Spec allowing prices to float for jobs instead of being fixed by the network.
Once the spec is ready, start development on floating prices

@10d9e Hey, let's have a chat soon about your ideas for how we can work on this

Power measurements: https://docs.google.com/spreadsheets/d/10HhbI9s9f7Bd9912S-e43g7LweZdP-tODMdBAplVBsk/edit?usp=drive_web&ouid=118113344480235922243

[ ] Measure other jobs
[ ] Measure SDXL jobs with other aspects (args like steps, etc)

https://www.amazon.co.uk/dp/B097YBXHTW <- recommendation use home assistant instead of the software that comes with it - integrations for energy plug monitoring, power readings every 5 secs instead of every minute with the stock software.


Change default branch name to match GitHub

As the default branch name for new repositories on GitHub has changed from master to main, this should be reflected in the action's default value for branch.

To keep backwards compatibility a master tag could be generated that points to the HEAD commit of the main branch.


Game crashes when using the "Gun game" Mutator

When getting a killed during a round of gun game the game will just sometimes close for seemingly no reason? It doesn't happen 100% of the time though.

Local or online game?
We need more information. Also if this is on a local server, could you could enable console logging to file and upload it here please?


Wrong process id

When i use my own written UWP application, Application.GetMainWindow() get stuck.
I've tried using Application.GetAllTopLevelWindows(Automation) but it returns 0 elements.
The reason of this is because the process id saved on the application is wrong, the correct one is another.
At the moment i'm using this way to retrieve my main window:
var desktop = Automation.GetDesktop();
var window = desktop.FindAllChildren(cf => cf.ByControlType(ControlType.Window).And(cf.ByName("Anthill"))).FirstOrDefault();
Assert.IsNotNull(window, $"Main window not found");
_mainWindow = window.AsWindow();
For info: i have a splash screen when my app opens, i read that it may be a problem but i didn't understand how to solve it.
Thanks

When running UITests>ApplicationTests>DisposeWhenClosed I get a System exception that it could not find the process. The ID it is looking for is incorrect. It seems that the info being passed back from System.Diagnostics.Process.StartInfo is incorrect.
I have no notepad process running in task Manager.

I then run DisposeWhenClosed test. It fails with the following information.

Notepad is still running but with processID 19364

When I ran it in debug mode the process being returned from process.start provides an ID of 28500

After some stack overflow research this may be occurring because the application is being launched in one process, the processID returned from process.start, but running in another. The explanations were murky to me. I resolved my situation by using Process.GetProcessesByName. I do kill all open processes of my application before I start testing just to be sure I am operating on the correc process.


Make SiteWhitelist mandatory during assignment; remove site wildcards…

…; updated cmsname Lexicon
Fixes #7535
Ideally, the validation should go under WMWorkloadTools, but I can't see how to distinguish creation from assignment and make it work with that special data type and the validate function. Seangchan, if you agree, I'd say we leave that up to the moment that we really separate creation from assignment arguments :-)
It passes all the basic tests.

@ticoann I still have to update the unit tests, but can you review it please?

test this please

test this please

test this please

tests are Ok in my VM (and agent)