not working and crushing few times

Please tick all applicable boxes.

[ x] I am using Python 3.5 or higher (run python --version on the command line)
[ x] I have followed the official guides to install the bot for my system
[ x] I have updated my dependencies to the latest version using the appropriate update script

Which version are you using?

[ ] The latest master version (1.9.8)

[ ] The latest review version
Starting MusicBot 1.9.8_4
What type of issue are you creating?

[ x] Bug

[ ] Feature request

[ ] Question

Description of issue
older version was working great did update it 2 days again and now am having issue every few hours sometime bots join channel and no voice  cannot play any song from cached
and sometime the sound just burst and then nothing is working
Steps to reproduce

updated the bot
Log file
Please attach your MusicBot log file (located at logs/musicbot.log) to this issue. You can do so by dragging and dropping the file here. If you do not include your log file, you WILL be asked to provide one.
[41.137456894] 2019-02-23 12:50:57,663 - INFO - launcher: Starting sanity checks
[42.136430740] 2019-02-23 12:50:57,664 - INFO - launcher: Checking for Python 3.5+
[42.136430740] 2019-02-23 12:50:57,664 - INFO - launcher: Checking console encoding
[42.136430740] 2019-02-23 12:50:57,664 - INFO - launcher: Setting console encoding to UTF-8
[42.136430740] 2019-02-23 12:50:57,664 - INFO - launcher: Ensuring we're in the right environment
[44.135808945] 2019-02-23 12:50:57,666 - INFO - launcher: Adding local bins/ folder to path
[734.310865402] 2019-02-23 12:50:58,356 - INFO - launcher: Required checks passed.
[734.310865402] 2019-02-23 12:50:58,356 - INFO - launcher: Optional checks passed.
[735.311269760] 2019-02-23 12:50:58,358 - INFO - launcher: Moving old musicbot log
######################### PRE-RUN SANITY CHECKS PASSED #########################
[1.6832387447357178] 2019-02-23 12:50:59,305 - WARNING - musicbot.config | In config.py::MainThread(17592), line 116 in run_checks: i18n file does not exist. Trying to fallback to config/i18n/en.json.
[1.6832387447357178] 2019-02-23 12:50:59,305 - INFO - musicbot.config | In config.py::MainThread(17592), line 127 in run_checks: Using i18n: config/i18n/en.json
[1.6862380504608154] 2019-02-23 12:50:59,308 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 226 in _setup_logging: Set logging level to INFO
[1.6892371177673340] 2019-02-23 12:50:59,311 - DEBUG - musicbot.json | In json.py::MainThread(17592), line 8 in init: Init JSON obj with config/i18n/en.json
[2.4190487861633301] 2019-02-23 12:51:00,041 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 91 in init: Starting MusicBot 1.9.8_4
[2.4300458431243896] 2019-02-23 12:51:00,052 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 97 in init: Loaded autoplaylist with 37 entries
[7.9075984954833984] 2019-02-23 12:51:05,530 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 922 in on_ready: Connection established, ready to go.
[7.9075984954833984] 2019-02-23 12:51:05,530 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 340 in _cache_app_info: Caching app info
[8.1545252799987793] 2019-02-23 12:51:05,777 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 744 in _scheck_ensure_env: Ensuring data folders exist
[8.1555252075195312] 2019-02-23 12:51:05,778 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 760 in _scheck_server_permissions: Checking server permissions
[8.1565468311309814] 2019-02-23 12:51:05,779 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 764 in _scheck_autoplaylist: Auditing autoplaylist
[8.1565468311309814] 2019-02-23 12:51:05,779 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 768 in _scheck_configs: Validating config
[8.1565468311309814] 2019-02-23 12:51:05,779 - DEBUG - musicbot.config | In config.py::MainThread(17592), line 217 in async_validate: Validating options...
[8.1565468311309814] 2019-02-23 12:51:05,779 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 771 in _scheck_configs: Validating permissions config
[8.1565468311309814] 2019-02-23 12:51:05,779 - DEBUG - musicbot.permissions | In permissions.py::MainThread(17592), line 94 in async_validate: Validating permissions...
[8.1575248241424561] 2019-02-23 12:51:05,780 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 939 in on_ready: Connected:<PHONE_NUMBER>51822848/Tazo Weed Lab#8253
[8.1575248241424561] 2019-02-23 12:51:05,780 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 947 in on_ready: Owner:<PHONE_NUMBER>10459136/tazo#0589
[8.1585252285003662] 2019-02-23 12:51:05,781 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 950 in on_ready: Guild List:
[8.1585252285003662] 2019-02-23 12:51:05,781 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 954 in on_ready:  - Topdark
[8.1595234870910645] 2019-02-23 12:51:05,782 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 954 in on_ready:  - Pain and Pleasure
[8.1595234870910645] 2019-02-23 12:51:05,782 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 1010 in on_ready: Not bound to any text channels
[8.1605231761932373] 2019-02-23 12:51:05,783 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 1036 in on_ready: Not autojoining any voice channels
[8.1605231761932373] 2019-02-23 12:51:05,783 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 264 in _join_startup_channels: Found resumable voice channel Pain and Pleasure/music-and-chill
[8.1615240573883057] 2019-02-23 12:51:05,784 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 270 in _join_startup_channels: Found owner in "music-and-chill"
[8.1615240573883057] 2019-02-23 12:51:05,784 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 279 in _join_startup_channels: Attempting to join Pain and Pleasure/music-and-chill
[9.5885000228881836] 2019-02-23 12:51:07,211 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 704 in deserialize_queue: Deserializing queue for<PHONE_NUMBER>10363146
[9.8227791786193848] 2019-02-23 12:51:07,445 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 423 in get_player: Created player via deserialization for guild<PHONE_NUMBER>10363146 with 1 entries
[9.8227791786193848] 2019-02-23 12:51:07,445 - INFO - musicbot.bot | In bot.py::MainThread(17592), line 295 in join_startup_channels: Joined Pain and Pleasure/music-and-chill
[9.8237798213958740] 2019-02-23 12:51:07,446 - DEBUG - musicbot.entry | In entry.py::MainThread(17592), line 56 in get_ready_future: Created future for audio_cache\youtube-pVLmZMjxfjw-Eiffel_65-_Blue_KNY_Factory_Remix.webm
[9.8237798213958740] 2019-02-23 12:51:07,446 - FFMPEG - musicbot.player | In player.py::MainThread(17592), line 273 in play: Creating player with options: -nostdin -vn audio_cache\youtube-pVLmZMjxfjw-Eiffel_65-_Blue_KNY_Factory_Remix.webm
[9.8287787437438965] 2019-02-23 12:51:07,451 - DEBUG - musicbot.player | In player.py::MainThread(17592), line 284 in _play: Playing <discord.player.PCMVolumeTransformer object at 0x000001CC0F9859E8> using <discord.voice_client.VoiceClient object at 0x000001CC0E7BF908>
[9.8297777175903320] 2019-02-23 12:51:07,452 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 458 in on_player_play: Running on_player_play
[9.8307774066925049] 2019-02-23 12:51:07,453 - DEBUG - musicbot.bot | In bot.py::MainThread(17592), line 680 in serialize_queue: Serializing queue for<PHONE_NUMBER>10363146

This log shows everything showing fine, your bug description is lackadaisical, I've read it several times and still am at a loss as to what exactly is happening to you, it appears English is not your first language as such I might suggest you come to the discord server

suddenly the voice get very high and then its all gone
and shutting down the bot and run it up again wont fix it only fix is i have to run the updater everytime this happen to fix it

This sounds like an internet issue, I'd suggest getting a vps

its not internet issue all the songs are already cached in the musicbot folder

Still has to send the audio to discord, regardless of whether it has to download the songs or not.

never had the issue before on previous version i was running it for more thank 5 month without even 1 issue

Regardless of the cause, if running the update script solves the issue, the next time the error occurs, you'll need to provide the output of the update script.

i will once it happens again

got this error am not sure if its releated to same issue or this is another one Fatal read error on pipe transport
protocol: <asyncio.sslproto.SSLProtocol object at 0x000001F6A240ED68>
transport: <_ProactorSocketTransport fd=808>
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\asyncio\proactor_events.py", line 189, in _loop_reading
data = fut.result()  # deliver data later in "finally" clause
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 697, in _poll
value = callback(transferred, key, ov)
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 437, in finish_recv
return ov.getresult()
OSError: [WinError 121] The semaphore timeout period has expired
Error in data transfer
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 528, in transfer_data
msg = yield from self.read_message()
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 580, in read_message
frame = yield from self.read_data_frame(max_size=self.max_size)
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 645, in read_data_frame
frame = yield from self.read_frame(max_size)
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 710, in read_frame
extensions=self.extensions,
File "C:\Program Files\Python35\lib\site-packages\websockets\framing.py", line 100, in read
data = yield from reader(2)
File "C:\Program Files\Python35\lib\asyncio\streams.py", line 668, in readexactly
yield from self._wait_for_data('readexactly')
File "C:\Program Files\Python35\lib\asyncio\streams.py", line 458, in _wait_for_data
yield from self._waiter
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 381, in iter
yield self  # This tells Task to wait for completion.
File "C:\Program Files\Python35\lib\asyncio\tasks.py", line 310, in _wakeup
future.result()
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\proactor_events.py", line 189, in _loop_reading
data = fut.result()  # deliver data later in "finally" clause
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 697, in _poll
value = callback(transferred, key, ov)
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 437, in finish_recv
return ov.getresult()
OSError: [WinError 121] The semaphore timeout period has expired
Fatal read error on pipe transport
protocol: <asyncio.sslproto.SSLProtocol object at 0x000001F6A25AA780>
transport: <_ProactorSocketTransport fd=900>
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\asyncio\proactor_events.py", line 189, in _loop_reading
data = fut.result()  # deliver data later in "finally" clause
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 697, in _poll
value = callback(transferred, key, ov)
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 437, in finish_recv
return ov.getresult()
OSError: [WinError 121] The semaphore timeout period has expired
Error in data transfer
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 528, in transfer_data
msg = yield from self.read_message()
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 580, in read_message
frame = yield from self.read_data_frame(max_size=self.max_size)
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 645, in read_data_frame
frame = yield from self.read_frame(max_size)
File "C:\Program Files\Python35\lib\site-packages\websockets\protocol.py", line 710, in read_frame
extensions=self.extensions,
File "C:\Program Files\Python35\lib\site-packages\websockets\framing.py", line 100, in read
data = yield from reader(2)
File "C:\Program Files\Python35\lib\asyncio\streams.py", line 668, in readexactly
yield from self._wait_for_data('readexactly')
File "C:\Program Files\Python35\lib\asyncio\streams.py", line 458, in _wait_for_data
yield from self._waiter
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 381, in iter
yield self  # This tells Task to wait for completion.
File "C:\Program Files\Python35\lib\asyncio\tasks.py", line 310, in _wakeup
future.result()
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\proactor_events.py", line 189, in _loop_reading
data = fut.result()  # deliver data later in "finally" clause
File "C:\Program Files\Python35\lib\asyncio\futures.py", line 294, in result
raise self._exception
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 697, in _poll
value = callback(transferred, key, ov)
File "C:\Program Files\Python35\lib\asyncio\windows_events.py", line 437, in finish_recv
return ov.getresult()
OSError: [WinError 121] The semaphore timeout period has expired

ot autojoining any voice channels
[ERROR:bot] Exception in on_voice_state_update
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\site-packages\discord\client.py", line 227, in _run_event
await coro(*args, **kwargs)
File "C:\Users\Taz.DESKTOP-BPGRUJ4\Music\MusicBot-master\MusicBot\musicbot\bot.py", line 2842, in on_voice_state_update
player = await self.get_player(channel)
File "C:\Users\Taz.DESKTOP-BPGRUJ4\Music\MusicBot-master\MusicBot\musicbot\bot.py", line 431, in get_player
'Use %ssummon to summon it to your voice channel.' % self.config.command_prefix)
musicbot.exceptions.CommandError: The bot is not in a voice channel.  Use !summon to summon it to your voice channel.
[52.984714508] 2019-02-24 12:58:06,905 - INFO - launcher: Starting sanity checks
[52.984714508] 2019-02-24 12:58:06,905 - INFO - launcher: Checking for Python 3.5+
[52.984714508] 2019-02-24 12:58:06,905 - INFO - launcher: Checking console encoding
[52.984714508] 2019-02-24 12:58:06,905 - INFO - launcher: Setting console encoding to UTF-8
[52.984714508] 2019-02-24 12:58:06,905 - INFO - launcher: Ensuring we're in the right environment
[54.985046387] 2019-02-24 12:58:06,907 - INFO - launcher: Adding local bins/ folder to path
[841.754674911] 2019-02-24 12:58:07,693 - INFO - launcher: Required checks passed.
[842.754602432] 2019-02-24 12:58:07,694 - INFO - launcher: Optional checks passed.
[842.754602432] 2019-02-24 12:58:07,694 - INFO - launcher: Moving old musicbot log
######################### PRE-RUN SANITY CHECKS PASSED #########################
[2.0873911380767822] 2019-02-24 12:58:08,939 - WARNING - musicbot.config | In config.py::MainThread(23592), line 116 in run_checks: i18n file does not exist. Trying to fallback to config/i18n/en.json.
[2.0873911380767822] 2019-02-24 12:58:08,939 - INFO - musicbot.config | In config.py::MainThread(23592), line 127 in run_checks: Using i18n: config/i18n/en.json
[2.0903909206390381] 2019-02-24 12:58:08,942 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 226 in _setup_logging: Set logging level to INFO
[2.0943906307220459] 2019-02-24 12:58:08,946 - DEBUG - musicbot.json | In json.py::MainThread(23592), line 8 in init: Init JSON obj with config/i18n/en.json
[2.6662225723266602] 2019-02-24 12:58:09,518 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 91 in init: Starting MusicBot 1.9.8_4
[2.6672222614288330] 2019-02-24 12:58:09,519 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 97 in init: Loaded autoplaylist with 37 entries
[8.1396267414093018] 2019-02-24 12:58:14,991 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 922 in on_ready: Connection established, ready to go.
[8.1396267414093018] 2019-02-24 12:58:14,991 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 340 in _cache_app_info: Caching app info
[8.4115471839904785] 2019-02-24 12:58:15,263 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 744 in _scheck_ensure_env: Ensuring data folders exist
[8.4125478267669678] 2019-02-24 12:58:15,264 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 760 in _scheck_server_permissions: Checking server permissions
[8.4125478267669678] 2019-02-24 12:58:15,264 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 764 in _scheck_autoplaylist: Auditing autoplaylist
[8.4125478267669678] 2019-02-24 12:58:15,264 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 768 in _scheck_configs: Validating config
[8.4125478267669678] 2019-02-24 12:58:15,264 - DEBUG - musicbot.config | In config.py::MainThread(23592), line 217 in async_validate: Validating options...
[8.4125478267669678] 2019-02-24 12:58:15,264 - DEBUG - musicbot.bot | In bot.py::MainThread(23592), line 771 in _scheck_configs: Validating permissions config
[8.4135470390319824] 2019-02-24 12:58:15,265 - DEBUG - musicbot.permissions | In permissions.py::MainThread(23592), line 94 in async_validate: Validating permissions...
[8.4135470390319824] 2019-02-24 12:58:15,265 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 939 in on_ready: Connected:<PHONE_NUMBER>51822848/Tazo Weed Lab#8253
[8.4135470390319824] 2019-02-24 12:58:15,265 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 947 in on_ready: Owner:<PHONE_NUMBER>10459136/tazo#0589
[8.4145479202270508] 2019-02-24 12:58:15,266 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 950 in on_ready: Guild List:
[8.4145479202270508] 2019-02-24 12:58:15,266 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 954 in on_ready:  - Topdark
[8.4145479202270508] 2019-02-24 12:58:15,266 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 954 in on_ready:  - Pain and Pleasure
[8.4145479202270508] 2019-02-24 12:58:15,266 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 1010 in on_ready: Not bound to any text channels
[8.4155464172363281] 2019-02-24 12:58:15,267 - INFO - musicbot.bot | In bot.py::MainThread(23592), line 1036 in on_ready: Not autojoining any voice channels
[12.2294340133666992] 2019-02-24 12:58:19,081 - ERROR - musicbot.bot | In bot.py::MainThread(23592), line 910 in on_error: Exception in on_voice_state_update
Traceback (most recent call last):
File "C:\Program Files\Python35\lib\site-packages\discord\client.py", line 227, in _run_event
await coro(*args, **kwargs)
File "C:\Users\Taz.DESKTOP-BPGRUJ4\Music\MusicBot-master\MusicBot\musicbot\bot.py", line 2842, in on_voice_state_update
player = await self.get_player(channel)
File "C:\Users\Taz.DESKTOP-BPGRUJ4\Music\MusicBot-master\MusicBot\musicbot\bot.py", line 431, in get_player
'Use %ssummon to summon it to your voice channel.' % self.config.command_prefix)
musicbot.exceptions.CommandError: The bot is not in a voice channel.  Use !summon to summon it to your voice channel.

sounds is gone now am tryin to fix it
[38.990020752] 2019-02-24 13:01:48,798 - INFO - launcher: Starting sanity checks
[38.990020752] 2019-02-24 13:01:48,798 - INFO - launcher: Checking for Python 3.5+
[38.990020752] 2019-02-24 13:01:48,798 - INFO - launcher: Checking console encoding
[38.990020752] 2019-02-24 13:01:48,798 - INFO - launcher: Setting console encoding to UTF-8
[39.988040924] 2019-02-24 13:01:48,799 - INFO - launcher: Ensuring we're in the right environment
[40.987253189] 2019-02-24 13:01:48,800 - INFO - launcher: Adding local bins/ folder to path
[671.073675156] 2019-02-24 13:01:49,430 - INFO - launcher: Required checks passed.
[671.073675156] 2019-02-24 13:01:49,430 - INFO - launcher: Optional checks passed.
[671.073675156] 2019-02-24 13:01:49,430 - INFO - launcher: Moving old musicbot log
######################### PRE-RUN SANITY CHECKS PASSED #########################
[1.5178010463714600] 2019-02-24 13:01:50,276 - WARNING - musicbot.config | In config.py::MainThread(23512), line 116 in run_checks: i18n file does not exist. Trying to fallback to config/i18n/en.json.
[1.5188100337982178] 2019-02-24 13:01:50,277 - INFO - musicbot.config | In config.py::MainThread(23512), line 127 in run_checks: Using i18n: config/i18n/en.json
[1.5198030471801758] 2019-02-24 13:01:50,278 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 226 in _setup_logging: Set logging level to INFO
[1.5218021869659424] 2019-02-24 13:01:50,280 - DEBUG - musicbot.json | In json.py::MainThread(23512), line 8 in init: Init JSON obj with config/i18n/en.json
[2.2373538017272949] 2019-02-24 13:01:50,996 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 91 in init: Starting MusicBot 1.9.8_4
[2.2383544445037842] 2019-02-24 13:01:50,997 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 97 in init: Loaded autoplaylist with 37 entries
[7.7496633529663086] 2019-02-24 13:01:56,508 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 922 in on_ready: Connection established, ready to go.
[7.7506630420684814] 2019-02-24 13:01:56,509 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 340 in _cache_app_info: Caching app info
[8.0105872154235840] 2019-02-24 13:01:56,769 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 744 in _scheck_ensure_env: Ensuring data folders exist
[8.0115866661071777] 2019-02-24 13:01:56,770 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 760 in _scheck_server_permissions: Checking server permissions
[8.0115866661071777] 2019-02-24 13:01:56,770 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 764 in _scheck_autoplaylist: Auditing autoplaylist
[8.0115866661071777] 2019-02-24 13:01:56,770 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 768 in _scheck_configs: Validating config
[8.0115866661071777] 2019-02-24 13:01:56,770 - DEBUG - musicbot.config | In config.py::MainThread(23512), line 217 in async_validate: Validating options...
[8.0125865936279297] 2019-02-24 13:01:56,771 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 771 in _scheck_configs: Validating permissions config
[8.0125865936279297] 2019-02-24 13:01:56,771 - DEBUG - musicbot.permissions | In permissions.py::MainThread(23512), line 94 in async_validate: Validating permissions...
[8.0125865936279297] 2019-02-24 13:01:56,771 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 939 in on_ready: Connected:<PHONE_NUMBER>51822848/Tazo Weed Lab#8253
[8.0135869979858398] 2019-02-24 13:01:56,772 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 947 in on_ready: Owner:<PHONE_NUMBER>10459136/tazo#0589
[8.0135869979858398] 2019-02-24 13:01:56,772 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 950 in on_ready: Guild List:
[8.0135869979858398] 2019-02-24 13:01:56,772 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 954 in on_ready:  - Topdark
[8.0145871639251709] 2019-02-24 13:01:56,773 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 954 in on_ready:  - Pain and Pleasure
[8.0145871639251709] 2019-02-24 13:01:56,773 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 1010 in on_ready: Not bound to any text channels
[8.0155863761901855] 2019-02-24 13:01:56,774 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 1036 in on_ready: Not autojoining any voice channels
[8.0155863761901855] 2019-02-24 13:01:56,774 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 264 in _join_startup_channels: Found resumable voice channel Pain and Pleasure/music-and-chill
[8.0155863761901855] 2019-02-24 13:01:56,774 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 270 in _join_startup_channels: Found owner in "music-and-chill"
[8.0165851116180420] 2019-02-24 13:01:56,775 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 279 in _join_startup_channels: Attempting to join Pain and Pleasure/music-and-chill
[9.4194648265838623] 2019-02-24 13:01:58,178 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 704 in deserialize_queue: Deserializing queue for<PHONE_NUMBER>10363146
[9.7062425613403320] 2019-02-24 13:01:58,465 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 423 in get_player: Created player via deserialization for guild<PHONE_NUMBER>10363146 with 1 entries
[9.7062425613403320] 2019-02-24 13:01:58,465 - INFO - musicbot.bot | In bot.py::MainThread(23512), line 295 in _join_startup_channels: Joined Pain and Pleasure/music-and-chill
[9.7072432041168213] 2019-02-24 13:01:58,466 - DEBUG - musicbot.entry | In entry.py::MainThread(23512), line 56 in get_ready_future: Created future for audio_cache\youtube-7MeKzmoHNTk-Dynamic_PVP_MIX_Playlist_Metalstep_industrial_melodic_drum_and_bass_electro_mix.m4a
[9.7072432041168213] 2019-02-24 13:01:58,466 - FFMPEG - musicbot.player | In player.py::MainThread(23512), line 273 in _play: Creating player with options: -nostdin -vn audio_cache\youtube-7MeKzmoHNTk-Dynamic_PVP_MIX_Playlist_Metalstep_industrial_melodic_drum_and_bass_electro_mix.m4a
[9.7112417221069336] 2019-02-24 13:01:58,470 - DEBUG - musicbot.player | In player.py::MainThread(23512), line 284 in _play: Playing <discord.player.PCMVolumeTransformer object at 0x000001A352948400> using <discord.voice_client.VoiceClient object at 0x000001A35290E5C0>
[9.7122416496276855] 2019-02-24 13:01:58,471 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 458 in on_player_play: Running on_player_play
[9.7122416496276855] 2019-02-24 13:01:58,471 - DEBUG - musicbot.bot | In bot.py::MainThread(23512), line 680 in serialize_queue: Serializing queue for<PHONE_NUMBER>10363146

update did fix the voice is back now i dunno what is the issue but its keep happening

As requested, whenever it happens again, please provide the output of the update script.

Hello looked into the  the winerror121, it appears to do with outdated network drivers, please check your network drivers are properly up to date. But as @AleanaA said please provide the output of the update script

Closing due to inactivity.


Using old version of cmd2 breaks in Python 3.10

Due to the old version of cmd2 used, clanvas no longer works in Python 3.10:
>>> import cmd2
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/michael/.local/lib/python3.10/site-packages/cmd2/__init__.py", line 13, in <module>
    from .cmd2 import Cmd, Statement, EmptyStatement, categorize
  File "/home/michael/.local/lib/python3.10/site-packages/cmd2/cmd2.py", line 48, in <module>
    from . import utils
  File "/home/michael/.local/lib/python3.10/site-packages/cmd2/utils.py", line 73, in <module>
    default_values: collections.Iterable = ()):
AttributeError: module 'collections' has no attribute 'Iterable'

In Python 3.10, Iterable was moved to collections.abc.
Several possible solutions:

Copy cmd2 directly into here (as using a specific version) and make the change manually / maintain independent version
Update clanvas to newer versions of cmd2
Don't support Python 3.10

I could probably do 1 if that's what you want to do.

Ah interesting. I admittedly don't have the time or interest in maintaining this at the moment.
Regarding solution 2, do you know if updating the version of cmd2 would be hard for some reason? That seems like the most straightforward solution.

To be honest I have no idea how difficult or easy it would be; I'm unfamiliar with how cmd2 works.

Unfortunately looking into it, the version of canvasapi used is also broken with Python 3.10, and I couldn't find an easy workaround.


mbedtls error when using private key on server

Godot version:
Godot Engine v3.2.1.stable.official - https://godotengine.org , server build
OS/device including version:
Ubuntu 18.04.4 LTS
Issue description:
Console prints mbedtls error: returned -0x7780 and connection is not established
Steps to reproduce:
Using the server build on linux try to use a private key from LetsEncrypt , then have a godot client connect.
Minimal reproduction project:
extends Node

var server: WebSocketServer = null

func _ready():
    server = WebSocketServer.new()
    server.private_key = load("res://privkey.key")
    server.ssl_certificate = load("res://fullchain.crt")
    server.listen(port, PoolStringArray(), true)
    get_tree().set_network_peer(server)

func _process(delta):
    if server.is_listening():
        server.poll()

Based on this issue thread: https://tls.mbed.org/discussions/crypto-and-ssl/mbedtls_x509_crt_parse-of-client-certificate-return-error-4480
It seems to be a platform specific error in how Godot is using the library

I was able to get more error messages when using the headless build instead of the server build:
thirdparty/mbedtls/library/ssl_tls.c:4369: mbedtls_ssl_handle_message_type() returned -30592 (-0x7780)
thirdparty/mbedtls/library/ssl_srv.c:3734: mbedtls_ssl_read_record() returned -30592 (-0x7780)
thirdparty/mbedtls/library/ssl_tls.c:8315: mbedtls_ssl_handshake() returned -30592 (-0x7780)
mbedtls error: returned -0x7780```

To clarify I have checked the privkey using openssl as the forum post suggested and all looks well

The keys I was using were out of date.... apologies

I have the exactly the same issue but with up-to-date keys. HTML5 exports are able to connect to the server successfully but standalone clients fail.
Reproduction project (using self-signed certificate): mbedtls-standalone.zip
Output:
thirdparty/mbedtls/library/ssl_tls.c:5865: x509_verify_cert() returned -9984 (-0x2700)
ERROR: _do_handshake: TLS handshake error: -9984
   At: modules/mbedtls/stream_peer_mbedtls.cpp:86.
mbedtls error: returned -0x2700

Client failed to connect
SCRIPT ERROR: _client_error: Assertion failed.
   At: res://main.gd:33.
thirdparty/mbedtls/library/ssl_tls.c:5286: is a fatal alert message (msg 42)
thirdparty/mbedtls/library/ssl_tls.c:4477: mbedtls_ssl_handle_message_type() returned -30592 (-0x7780)
thirdparty/mbedtls/library/ssl_srv.c:3759: mbedtls_ssl_read_record() returned -30592 (-0x7780)
thirdparty/mbedtls/library/ssl_tls.c:8425: mbedtls_ssl_handshake() returned -30592 (-0x7780)
mbedtls error: returned -0x7780

So apparently the issue was that I mistakenly used chain.pem instead of fullchain.pem. Using the latter fixes the issue.
The error is very vague and I feel like this should at least be documented somewhere.

cc @Faless

In general, SSL is based on a chain of trust.
The whole chain must be trusted for the certificate to be trusted.
Browsers comes with quite a few trusted top-level certificates, so you don't always need the full chain in browsers.
Tools that checks SSL validity also easily spot and report the fact that the full chain is missing (e.g. https://www.digicert.com/help/)

In general, SSL is based on a chain of trust.
The whole chain must be trusted for the certificate to be trusted.
Browsers comes with quite a few trusted top-level certificates, so you don't always need the full chain in browsers.
Tools that checks SSL validity also easily spot and report the fact that the full chain is missing (e.g. https://www.digicert.com/help/ or https://www.sslshopper.com/ssl-checker.html)

Those links should be on the websockets doc page https://docs.godotengine.org/en/stable/tutorials/networking/websocket.html

In general, SSL is based on a chain of trust.
The whole chain must be trusted for the certificate to be trusted.
Browsers comes with quite a few trusted top-level certificates, so you don't always need the full chain in browsers.
Tools that checks SSL validity also easily spot and report the fact that the full chain is missing (e.g. https://www.digicert.com/help/ or https://www.sslshopper.com/ssl-checker.html)

Those links should be on the websockets doc page https://docs.godotengine.org/en/stable/tutorials/networking/websocket.html

I'm getting the same error.
I have used letsencrypt to generate my keys:
Congratulations! Your certificate and chain have been saved at:
/etc/letsencrypt/live/mydomain.io/fullchain.pem
Your key file has been saved at:
/etc/letsencrypt/live/mydomain.io/privkey.pem

I am converting .pem files into certificate.crt and private.key files like so:
openssl x509 -outform der -in /etc/letsencrypt/live/mydomain.io/fullchain.pem -out certificate.crt
openssl rsa -outform der -in /etc/letsencrypt/live/mydomain.io/privkey.pem -out private.key

To start a server, I'm doing:
var net = WebSocketServer.new()
net.private_key = load("res://HTTPSKeys/private.key")
net.ssl_certificate = load("res://HTTPSKeys/certificate.crt")
net.listen(PORT, PoolStringArray(), true)

On client, I'm trying to connect to the server like so:
net = WebSocketClient.new()
var error = net.connect_to_url('wss://<IP_ADDRESS>:6969', PoolStringArray(), true)

The complete code for the project is here.
Can someone please help me to figure out what I'm doing wrong?

var error = net.connect_to_url('wss://<IP_ADDRESS>:6969', PoolStringArray(), true)

@lumenwrites Well, you need to put the fully qualified domain name there, not the IP address. The browser is also telling you that: ERR_CERT_COMMON_NAME_INVALID

@Faless Oh my god, thank you SO much!!! It works now! AMAZING. I'm so happy!!

Closed via #47708

Is there any way to run wss:// every time across the local network?
For me around 50% of the times this is working just fine, and the other 50% it's failing with mbedtls error: returned -0x6c00. I had to track down this bug report from google as the error is still confusing on 3.3.2

Is there any way to run wss:// every time across a LAN?
This would be useful when using godot for IoT and other local apps. See this stack overflow question for more information of use-cases.
For me around 50% of the times this is working just fine, and the other 50% it's failing with mbedtls error: returned -0x6c00. I had to track down this bug report from google as the error is still confusing on 3.3.2
If it shouldn't work I'm confused about the 50% of the time it seems to work 🤔 Perhaps we should display a friendly error message like: "wss is only supported with a qualified domain name"

@tavurth I have a client, server1 and server2. Server1 is open to the world, using let's encrypt certs for the client. Server2 is only opened to server1. When a client connects to server1, server1 connects to server2 with a self signed cert (think this is where the issue is). I'm on Godot 4.0.4 and I am getting this exact error. It only happens once in a while, but once it happens, no one can connect until I restart server1. I'm also using an ip instead of a url since I don't have a domain name for that server. Did you ever figure out this issue? I'm not using websocket but I am doing something like this:
// This part is for the server and client, it should be fine.
//server1
        var m_net = ENetMultiplayerPeer.new()
	m_net.create_server(port, 4000)
	m_publicKey = load_pem_file("/home/username/fullchain_copy.pem")
	var publicKey = X509Certificate.new()
	var error = publicKey.load("/home/username/fullchain_copy.pem")
	var privateKeyPem = load_pem_file("/home/username/privkey_copy.pem")
	var privateKey = CryptoKey.new()
	privateKey.load_from_string(privateKeyPem)
	m_net.host.dtls_server_setup(TLSOptions.server(privateKey, publicKey))

// client
	m_net = ENetMultiplayerPeer.new()
	m_net.create_client("urlHere", xxx)
	m_net.host.dtls_client_setup("urlHere", TLSOptions.client())
	multiplayer.set_multiplayer_peer(m_net)

//This is where the issue is I think when server1 connects to server2

// server1 (connects to server2):
	m_net = ENetMultiplayerPeer.new()
	m_net.create_client("xxx.xxx.xxx.xxx", xxxx)
	var publicKey = X509Certificate.new()
	publicKey.load("/home/username/publicKey.pem")
	m_net.host.dtls_client_setup("serverName", TLSOptions.client_unsafe(publicKey))

//server2:
        var m_net = ENetMultiplayerPeer.new()
	m_net.create_server(xxxx, 4000)
        var publicKey = X509Certificate.new()
	publicKey.load("/home/username/publicKey.pem")
	var privateKey = CryptoKey.new()
	var privateKeyPem = load_pem_file("/home/username/privateKey.pem")
	privateKey.load_from_string(privateKeyPem)
	m_net.host.dtls_server_setup(TLSOptions.server(privateKey, publicKey))
	multiplayer.set_multiplayer_peer(m_net)

func load_pem_file(file_path: String) -> String:
	var file = FileAccess.open(file_path, FileAccess.READ)
	if file:
		var pem_content : String = file.get_as_text()
		file.close()
		return pem_content
	else:
		print("Failed to open PEM file.")
		return ""

If anyone else has any ideas, let me know.


No globbing wildcard support on Windows

zq doesn't do globbing; it relies on the shell to do it. Unfortunately, the "stock" Windows shells like Command Prompt and PowerShell don't handle this. Therefore command lines with wildcards (such as many shown in the ZQL docs) won't work on Windows.

We could add our own globbing support in zq, or if we chose not to, perhaps we could detect when the user attempts to use a glob and explicitly mention that it's not supported and point them at alternate shells. At minimum, we should definitely improve the current error message:
*.log: CreateFile *.log: The filename, directory name, or volume label syntax is incorrect.

...as the mention of CreateFile is confusing to me as a user.

@philrz how do other windows command line tools handle globbing?

@mattnibs: The tl;dr (such as captured in this StackOverflow post) seems to be:

DOS, and consequently Windows' cmd.exe, never supported wildcard expansion by the shell. It was always up to the application to do the expansion. [emphasis added]

Therefore, when you say "other Windows command line tools", the follow-on question seems to be "Which ones?", since it sounds like some may do the expansion and some will not. The built-ins commonly used in a Command Prompt shell do it, e.g.:
C:\Users\Phil\Desktop\zq-881>dir *.log
 Volume in drive C has no label.

This speaks to my concern: Power users probably know to expect spotty behavior in this area, and those same power users are likely to be using other bash-like shells for precisely this reason. However, as we also know, a lot of Windows users are not power users. Maybe non-power-users are also less likely to be doing stuff at the shell, which is part of the reason why I'd be on-board at not implementing the globbing ourselves, as long as we at least improve the error message. OTOH if there were a simple Go library that does this, such that we could effectively have an "if on Windows, pass the file parameter(s) through that lib first", no doubt it would be a nice convenience, but I could imagine it not being that simple.


Adding Universidad Tecnologica de Pereira - Colombia. To the domains folder

Official Site: https://www.utp.edu.co/
Bachelor's degree in computer science equivalent site (Ingenieria de sistemas): https://ingenierias.utp.edu.co/ingenieria-en-sistemas/
Students Portal: https://app4.utp.edu.co/pe/utp.php ->

@JorgeMarioHerrera I am sorry, the domain utp.edu.co is removed from our trusted domains list because it was abused in the past. If you are the student of this school, please enroll to GitHub Student Developer Program. Then apply for JetBrains educational subscription with your GitHub account (GitHub tab at https://www.jetbrains.com/shop/eform/students).


Remove "underline text on rollover" effect from Kong Hub cards

When visiting https://docs.konghq.com/hub/, rolling over a card causes the text on that card to be underlined. This is distracting and unnecessary.

I’ll take a look at this!

Whoops, this got fixed but the issue didn't get closed.


Cleanup README

Some of the items about the status of the project no longer apply.

Farewell. This was a fun project in 2011-2012.


Crop params in percent size

Hi,
Thanks for this tool. It looks amazing !
My use case is to crop images by giving left-top and right-bottom coords as percent of width and height of the image.
So the params would be float values between 0 and 1, such as "0.10x0.08:0.26x0.43".
Of course, I don't have image width and height infos on the client side, otherwise it would have been easy to compute pixels-coords automatically.
Is there any way to achieve this with the current version of Imagor ? If not, would you be open to a PR ?

Imagor currently does not support crop by percentage. PR is welcomed :)

Crop params in percentage is now available in docker image shumc/imagor:0.8.11!


Add analytics

This just does a test logEvent -- real ones to be added next

Oof -- will chek the Gradle files

The only differences I can see related to FIrebase Analytics (and Crashlytics) in the build.gradle file are:
   debugImplementation 'com.google.firebase:firebase-analytics:17.4.0'
    //Firebase Crashlytics dependency.
    debugImplementation 'com.crashlytics.sdk.android:crashlytics:2.10.1'

vs "implementation" in my app-level build.gradle file

Also qq, didn't see a TestEvent in Analytics as is -- I'm about to test locally but should there be/am I looking the right spot?

I takes several hours to see the events in Firebase Analytics.  There is a DebugView where you can see the result from the device you are testing on:

Requested changes made.
BTW, You can send a Firebase event from an emulator or device and it will appear in DebugView.  To do this, after starting the app, you need to type in the console:
adb shell setprop debug.firebase.analytics.app "edu.stanford.covidwatch.android"

3rd check shouldn't have run on this PR, it compiles now


Japanese iOS users IME bug

We've deployed this code (via Woocommerce / Stripe) on two Japanese websites and found it's impossible to input card numbers while using a Japanese iOS keyboard.
Please see following bug demo video.
https://www.youtube.com/watch?v=MEpelmggcsE
I've typed 424242 but<PHONE_NUMBER> has appeared
Expected behaviour
Entered card number should appear in field as entered
Actual behaviour
When a space is entered by jquery.payment of the 4th character it breaks the last character off the Japanese IME into the field then continues input with the IME
Steps to reproduce
Enter a card number using the default Japanese keyboard on iOS
Problem code
jquery.payment.js l:240

Just following this up - the same thing happens in the expiry field. For anyone else facing this problem we've found a terrible hack which works: detecting the user agent then changing the field type to tel.

Not a hack at all. It's in the readme :) https://github.com/stripe/jquery.payment#mobile-recommendations


Rename proposal

When using such libraries it is common to have a wrapper around library service that will care about notification templates, error handling or additional logic that could be required by particular application.
In my case I would like to create IPushNotificationService that will wrap you library service, but I cant do that because your library expose such interface. I was thinking about other names for my service but couldn't find anything enough verbose and precise.
So I would propose to rename IPushNotificationService to something more related to your library, like IFCMPushNotificationService.

I see your point and will consider that going forward, but this would be a breaking change so I won't do it for now (possibly reserved till version 2.x)
Meanwhile creating your own IPushNotificationService that inherits from the one provided by the library should still be possible:
public interface IPushNotificationService : ACB.FCMPushNotifications.IPushNotificationService

and if needed:
using IPushNotificationService = MyProject.IPushNotificationService;


fix(package): make environment variables work properly for all platforms

Can you double check if applied right, @plumdumpling
https://www.npmjs.com/package/cross-env#cross-env-vs-cross-env-shell
Also please check if I forgot sth, I think/hope I got all of them.

Let's see if it works 🙂

Needed to remove it and add a note for windows users as tests are failing this way.
https://github.com/ubilabs/google-maps-react-hooks/actions/runs/3463634036/jobs/5784142887
I guess it is what he is saying here:

Now I have to figure out how to use a different .npmrc per platform so every developer doesn't have to create their own config file. 😕

@plumdumpling Do you think we should add the note to all the example readmes below the api key instruction as well?

@plumdumpling Do you think we should add the note to all the example readmes below the api key instruction as well?

I think this is only needed in the development and to start the examples, right? So I think you can remove the Windows instructions from the library README and add it to the examples README.
Can you please also add a comment to our internal Troubleshooting issue, so that we don't forget to add this to the Troubleshooting Guide.

@plumdumpling Do you think we should add the note to all the example readmes below the api key instruction as well?

I think this is only needed in the development and to start the examples, right? So I think you can remove the Windows instructions from the library README and add it to the examples README. Can you please also add a comment to our internal Troubleshooting issue, so that we don't forget to add this to the Troubleshooting Guide.

As far as I understood in the issue, the installation of the library neither worked - because of the env variables. But this could also be because of the postinstall in the older version.


[ISSUE-378][HugePartition][Part-2] Introduce memory usage limit and data flush

What changes were proposed in this pull request?

Introduce memory usage limit for huge partition to keep the regular partition writing stable
Once partition is marked as huge-partition, when its buffer size is greater than rss.server.single.buffer.flush.threshold value,  single-buffer flush will be triggered whatever the single buffer flush is enabled or not

Why are the changes needed?

To solve the problems mentioned by #378

Does this PR introduce any user-facing change?
Yes.
How was this patch tested?

UTs

I don't think we should introduce a new configuration to control buffer flush. rss.server.single.buffer.flush.enabled can be used for the huge partition buffer flush purpose. If the huge partition limit is enabled, the single buffer flush could be enabled automatically.

If single buffer flush could be enabled automatically, how to set the flush threshold size? I don't hope the rss.server.single.buffer.flush.enabled is enabled for regular partitions, which could be flushed to ssd/hdd directly instead of cold storage. And huge partition could be flushed to HDFS.

I think these two similar configurations will bring more confusion to end user.

Emm. Yes.

It seems I got your point. The conf of rss.server.single.buffer.flush.threshold should be specified especially for huge partition whatever the single buffer flush is enabled or not. Right?

Codecov Report

Merging #471 (9907b6f) into master (19a8bac) will decrease coverage by 0.57%.
The diff coverage is 70.37%.

@@             Coverage Diff              @@
##             master     #471      +/-   ##
============================================
- Coverage     58.78%   58.20%   -0.58%
+ Complexity     1704     1494     -210
============================================
  Files           206      184      -22
  Lines         11471     9684    -1787
  Branches       1024      873     -151
============================================
- Hits           6743     5637    -1106
+ Misses         4317     3676     -641
+ Partials        411      371      -40

Impacted Files
Coverage Δ

...pache/uniffle/server/ShuffleServerGrpcService.java
0.79% <0.00%> (-0.02%)
:arrow_down:

...he/uniffle/server/buffer/ShuffleBufferManager.java
82.14% <76.19%> (-0.62%)
:arrow_down:

.../org/apache/uniffle/server/ShuffleTaskManager.java
76.57% <78.57%> (+0.01%)
:arrow_up:

...a/org/apache/uniffle/server/ShuffleServerConf.java
99.31% <100.00%> (+0.02%)
:arrow_up:

...storage/handler/impl/DataSkippableReadHandler.java
83.78% <0.00%> (-2.71%)
:arrow_down:

...org/apache/spark/shuffle/writer/AddBlockEvent.java

...e/spark/shuffle/reader/RssShuffleDataIterator.java

...g/apache/hadoop/mapred/SortWriteBufferManager.java

...rg/apache/hadoop/mapred/RssMapOutputCollector.java

...k/shuffle/writer/WrappedByteArrayOutputStream.java

... and 18 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

So, I think we could reuse the rss.server.single.buffer.flush.threshold settings, which is 64MB by default. We don't have to introduce rss.server.huge-partition.memory.limit.ratio ?

Memory limit is required. Usually the huge partition writing speed is fast, and the HDFS flushing speed is slower than writing. If missing memory limit, the regular partitions will be affected.
By the way, this design has been introduced into our internal version, it works well. Before this PR, sometimes one huge partition will make other regular partitions buffer require fail.

I'm ok to add rss.server.huge-partition.size.threshold setting, which is used to add memory limit. I just think maybe we should reuse rss.server.single.buffer.flush.threshold instead of another rss.server.huge-partition.memory.limit.ratio settings?

This suggestion has been accepted 😁. Please review the latest code.

rss.server.huge-partition.memory.limit.ratio is the conf for memory limitation instead of buffer flush threshold

PTAL @advancedxy. After this PR is merged, I will introduce some metrics about huge partition.

Merged. Thanks for your review @advancedxy


Enable explicit Ruff check rules

As penance for not following PEP 8, I have selected reviewers to learn from some of the changes I made. 😉

Great job! I copied some of the rules to my project, thank you! 🙏
I can also recommend the following ones I currently use:
select = [
    # ...
    "C90",  # mccabe
    "FIX",  # flake8-fixme
    "S",  # flake8-bandit
    # ...
]

mccabe checks complexity https://docs.astral.sh/ruff/rules/complex-structure/#complex-structure-c901 :
[tool.ruff.lint.mccabe]
max-complexity = 6

flake8-fixme looks for FIXME, TODO and other temporary developer notes.
flake8-bandit looks for security flaws.

I can also recommend the following ones I currently use

Thanks for the suggestions, but I purposefully left those out as they either go against how we already do things (e.g. TODO is fine), or I find unnecessary (e.g. McCabe).


Initialize plugin instances in parallel

When I profiled my build, I saw that the application was idling quite a long time at the beginning (in my project it was around 700ms). This is because happypack uses the run and the watch-run hook which is not executed in parallel. That means that webpack waits for each happypack instance to initialize which you can clearly see in the profile (in this artificial example we have three instances):

I made a quick-and-dirty test and tried to use the make hook instead of the run hook (which is executed in parallel):

If you want to play around with that, you can take a look at my example repo. Since I refactored happypack inside my node_modules, I can't commit that. But it's fairly easy to add that change to happypack since the compiler is already passed to apply. Of course you need to make sure that start() is not called multiple times in watch mode.
I haven't tested it thoroughly but wanted to propose that change to shorten the startup time.

TIL! Thanks @jhnns that's good to know. I'll play with this.
Now that I think about it, we could warm the thread pool up even before webpack starts since as of 3.0 the initialization of the threads got decoupled from webpack compiler registration.
Are you using the blink profiler after the profiling changes introduced by node 6? I remember when I started writing happypack I couldn't much meaningful profiling information, tried using node-inspector. This would help a lot.

Now that I think about it, we could warm the thread pool up even before webpack starts since as of 3.0 the initialization of the threads got decoupled from webpack compiler registration.

That makes totally sense :+1:

Are you using the blink profiler after the profiling changes introduced by node 6?

Yes. Check out the start script. This will print a chrome debugger URL into the console which you can use to start the debugger/profiler.

BTW: Depending on your OS, this profile may look very different. When I was experimenting with child processes a lot, I remembered that Linux was way faster in spawning processes.

@jhnns any chance you could try out #112 and see if it has any benefit? I didn't see any tangible results on Linux and need some time to try out on OS X.

I can see a slightly performance improvement in my test scenario. Both pictures show the same time span (<400ms):
Before

After

In a real-world project I couldn't see any improvement :(. I suspect, that this change will have a greater effect, the more plugin instances you have.

Man, that's too bad. We can try on that redux project which uses many instances, see if there's any gain there.
I believe the biggest gain we'll get from further optimizations is in some webpack routines and in babel transformers. Personally, I'm gonna look into babel optimizations soon because I see you guys are working hard on optimizing webpack 2 which is great.
I'd also still like to integrate happypack into webpack core, but there's very little time on my hands. :disappointed:

I'd also still like to integrate happypack into webpack core, but there's very little time on my hands.

This is definitely a goal on the long run. Happypack is really helpful as proof of concept in this regard. Unfortunately we have to figure out a way for loaders that rely on the _compiler instance. Maybe we could also keep these loaders inside the main thread for now.

Gonna close this since it's not as good as we had hoped and it's been a while


New app: date picker with varios plots

Thank you @nidhikamath2102 for the app that you sent me. I am attaching your code below with a few updates.

I changed the component IDs because IDs have a specific format for apps on the Dash Example Index.
I made it so the app will display a graph when it first loads, so that it looks better on the home page of the Example Index site.

A couple of questions:

What's the reason for the time.sleep(0.25)
@AnnMarieW , in this app Nidhi chose to use css for styling instead of DBC. I don't think we have too many apps using CSS, so I'm inclined to leave it to help beginners learn from her code. What do you think?

File name: datepicker-plots.py
import pandas as pd
from dash import Dash, dcc, html, Input, Output, State
import plotly.express as px
import dash_bootstrap_components as dbc
import time

df = px.data.stocks()
df['date'] = pd.to_datetime(df['date'])
app = Dash(__name__, external_stylesheets=[dbc.themes.BOOTSTRAP])

app.layout = html.Div([
    html.Label('Plot Type', style={'margin-bottom': '5px', 'font-weight': 'bold'}),
    dcc.Dropdown(
        id='datepicker-plots-x-dropdown',
        options=[
            {'label': 'Select a plot', 'value': ''},
            {'label': 'Line Plot', 'value': 'line'},
            {'label': 'Scatter Plot', 'value': 'scatter'},
            {'label': 'Area Plot', 'value': 'area'},
            {'label': 'Correlation Matrix', 'value': 'correlation'}
        ],
        value='correlation',
        className='mb-3'
    ),
    html.Div([
        html.Div([
            html.Label('Start Date', style={'margin-right': '10px', 'font-weight': 'bold'}),
            dcc.DatePickerSingle(
                id='datepicker-plots-x-start-date',
                date=df['date'].min(),
                min_date_allowed=df['date'].min(),
                max_date_allowed=df['date'].max(),
                placeholder='Select a date'
            ),
        ], style={'margin-right': '20px'}),
        html.Div([
            html.Label('End Date', style={'margin-right': '10px', 'font-weight': 'bold'}),
            dcc.DatePickerSingle(
                id='datepicker-plots-x-end-date',
                date=df['date'].max(),
                min_date_allowed=df['date'].min(),
                max_date_allowed=df['date'].max(),
                placeholder='Select a date'
            ),
        ], style={'margin-left': '20px'}),
    ], style={'display': 'flex', 'justify-content': 'space-evenly'}),

    html.Div([
        dbc.Button('Submit', id='datepicker-plots-x-submit', n_clicks=0, color="primary", className="mr-1")
    ], style={'display': 'flex', 'justify-content': 'center', 'margin-top': '20px'}),
    html.Div(id='datepicker-plots-x-error-msg', style={'color': 'orange', 'margin-top': '20px', 'font-size': 30, 'text-align': 'center'}),
    dcc.Loading(
        id="datepicker-plots-x-loading",
        type="circle",
        children=[html.Div(id='datepicker-plots-x-graph', children=[], style={'margin-top': '20px'})],
    ),
])

@app.callback(
        Output('datepicker-plots-x-graph', 'children'),
        Output('datepicker-plots-x-error-msg', 'children'),
        Input('datepicker-plots-x-submit', 'n_clicks'),
        State('datepicker-plots-x-dropdown', 'value'),
        State('datepicker-plots-x-start-date', 'date'),
        State('datepicker-plots-x-end-date', 'date')
)
def update_graph(n_clicks, plot_type, start_date, end_date):
    if not plot_type:
        return [], 'Please select a plot type!'
    if not start_date:
        return [], 'Please select a start date!'
    if not end_date:
        return [], 'Please select an end date!'
    if end_date <= start_date:
        return [], 'End date should be greater than start date!'

    mask = (df['date'] >= start_date) & (df['date'] <= end_date)
    filtered_df = df.loc[mask]

    time.sleep(0.25)

    plot_funcs = {
        'line': px.line,
        'scatter': px.scatter,
        'area': px.area,
        'correlation': lambda data, x, y: px.imshow(data.corr())
    }

    if plot_type == 'correlation':
        fig = plot_funcs[plot_type](filtered_df.drop('date', axis=1), x=None, y=None)
    else:
        fig = plot_funcs[plot_type](filtered_df, x='date', y=filtered_df.columns.drop('date'))

    return dcc.Graph(figure=fig), ''

if __name__ == '__main__':
    app.run_server(debug=True)

Hi,
To address the above concerns,

I added the time.sleep(0.25) for showing the loader. Without that the
loader for this example would quickly disappear since the data loads
quickly. I wanted the custom spinner to look more visible, hence added a
short delay as that was the main goal of the app.

Let me know if anything needs to be changed. Have a great weekend!
Best,
Nidhi
On Fri, Jun 7, 2024 at 3:39 PM Adam @.***> wrote:

Thank you @nidhikamath2102 https://github.com/nidhikamath2102 for the
app that you sent me. I am attaching your code below with a few updates.

I changed the component IDs because IDs have a specific format for
apps on the Dash Example Index.
I made it so the app will display a graph when it first loads, so
that it looks better on the home page of the Example Index site.

A couple of questions:

What's the reason for the time.sleep(0.25)
@AnnMarieW https://github.com/AnnMarieW , in this app Nidhi chose
to use css for styling instead of DBC. I don't think we have too many apps
using CSS, so I'm inclined to leave it to help beginners learn from her
code. What do you think?

File name: datepicker-plots.py
import pandas as pd
from dash import Dash, dcc, html, Input, Output, State
import plotly.express as px
import dash_bootstrap_components as dbc
import time
df = px.data.stocks()
df['date'] = pd.to_datetime(df['date'])
app = Dash(name, external_stylesheets=[dbc.themes.BOOTSTRAP])
app.layout = html.Div([
html.Label('Plot Type', style={'margin-bottom': '5px', 'font-weight': 'bold'}),
dcc.Dropdown(
id='datepicker-plots-x-dropdown',
options=[
{'label': 'Select a plot', 'value': ''},
{'label': 'Line Plot', 'value': 'line'},
{'label': 'Scatter Plot', 'value': 'scatter'},
{'label': 'Area Plot', 'value': 'area'},
{'label': 'Correlation Matrix', 'value': 'correlation'}
],
value='correlation',
className='mb-3'
),
html.Div([
html.Div([
html.Label('Start Date', style={'margin-right': '10px', 'font-weight': 'bold'}),
dcc.DatePickerSingle(
id='datepicker-plots-x-start-date',
date=df['date'].min(),
min_date_allowed=df['date'].min(),
max_date_allowed=df['date'].max(),
placeholder='Select a date'
),
], style={'margin-right': '20px'}),
html.Div([
html.Label('End Date', style={'margin-right': '10px', 'font-weight': 'bold'}),
dcc.DatePickerSingle(
id='datepicker-plots-x-end-date',
date=df['date'].max(),
min_date_allowed=df['date'].min(),
max_date_allowed=df['date'].max(),
placeholder='Select a date'
),
], style={'margin-left': '20px'}),
], style={'display': 'flex', 'justify-content': 'space-evenly'}),
html.Div([
    dbc.Button('Submit', id='datepicker-plots-x-submit', n_clicks=0, color="primary", className="mr-1")
], style={'display': 'flex', 'justify-content': 'center', 'margin-top': '20px'}),
html.Div(id='datepicker-plots-x-error-msg', style={'color': 'orange', 'margin-top': '20px', 'font-size': 30, 'text-align': 'center'}),
dcc.Loading(
    id="datepicker-plots-x-loading",
    type="circle",
    children=[html.Div(id='datepicker-plots-x-graph', children=[], style={'margin-top': '20px'})],
),

])
@app.callback(
Output('datepicker-plots-x-graph', 'children'),
Output('datepicker-plots-x-error-msg', 'children'),
Input('datepicker-plots-x-submit', 'n_clicks'),
State('datepicker-plots-x-dropdown', 'value'),
State('datepicker-plots-x-start-date', 'date'),
State('datepicker-plots-x-end-date', 'date')
)
def update_graph(n_clicks, plot_type, start_date, end_date):
if not plot_type:
return [], 'Please select a plot type!'
if not start_date:
return [], 'Please select a start date!'
if not end_date:
return [], 'Please select an end date!'
if end_date <= start_date:
return [], 'End date should be greater than start date!'
mask = (df['date'] >= start_date) & (df['date'] <= end_date)
filtered_df = df.loc[mask]

time.sleep(0.25)

plot_funcs = {
    'line': px.line,
    'scatter': px.scatter,
    'area': px.area,
    'correlation': lambda data, x, y: px.imshow(data.corr())
}

if plot_type == 'correlation':
    fig = plot_funcs[plot_type](filtered_df.drop('date', axis=1), x=None, y=None)
else:
    fig = plot_funcs[plot_type](filtered_df, x='date', y=filtered_df.columns.drop('date'))

return dcc.Graph(figure=fig), ''

if name == 'main':
app.run_server(debug=True)
image.png (view on web)
https://github.com/AnnMarieW/dash-app-gallery/assets/32049495/56fbc34e-3242-4d5f-96f6-a568cabc5a4e
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4A5OWF4V7TLHWEOU6DZGID6PAVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43ASLTON2WKOZSGM2DCMBVGY2TSNI
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi @nidhikamath2102
This app will make a nice addition - thanks for the submission!  It will be easier to finish the review by creating a pull request.
We have a extensive and detailed code review to ensure the project maintains its high quality and consistent coding style. You can find all the details in our Contributing Guide.  Note that you don't have to do all of the things outlined in the guide yourself - just let us know how you would like to be involved.
To start, would you like to create the PR?  If not, I can do that and we continue the discussion and review over there.

Glad that I could contribute.
Yes, I would like to do a PR.
Best,
Nidhi
On Mon, 10 Jun, 2024, 12:47 Ann Marie Ward, @.***>
wrote:

Hi @nidhikamath2102 https://github.com/nidhikamath2102
This app will make a nice addition - thanks for the submission! It will be
easier to finish the review by creating a pull request.
We have a extensive and detailed code review to ensure the project
maintains its high quality and consistent coding style. You can find all
the details in our Contributing Guide
https://github.com/AnnMarieW/dash-app-gallery/blob/main/CONTRIBUTING.md.
Note that you don't have to do all of the things outlined in the guide
yourself - just let us know how you would like to be involved.
To start, would you like to create the PR? If not, I can do that and we
continue the discussion and review over there.
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159#issuecomment-2158854481,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4CM3PMTU2COZ2AJHWTZGXKDBAVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJYHA2TINBYGE
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi,
Can you help me with this? For which project should I take the pull request?
Best,
Nidhi
On Mon, Jun 10, 2024 at 2:26 PM Nidhi Kamath @.***>
wrote:

Glad that I could contribute.
Yes, I would like to do a PR.
Best,
Nidhi
On Mon, 10 Jun, 2024, 12:47 Ann Marie Ward, @.***>
wrote:

Hi @nidhikamath2102 https://github.com/nidhikamath2102
This app will make a nice addition - thanks for the submission! It will
be easier to finish the review by creating a pull request.
We have a extensive and detailed code review to ensure the project
maintains its high quality and consistent coding style. You can find all
the details in our Contributing Guide
https://github.com/AnnMarieW/dash-app-gallery/blob/main/CONTRIBUTING.md.
Note that you don't have to do all of the things outlined in the guide
yourself - just let us know how you would like to be involved.
To start, would you like to create the PR? If not, I can do that and we
continue the discussion and review over there.
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159#issuecomment-2158854481,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4CM3PMTU2COZ2AJHWTZGXKDBAVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNJYHA2TINBYGE
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi @nidhikamath2102
Adam has a good video on how to do PRs here:  https://www.youtube.com/watch?v=Xth83OD3NNc
To start fork this repo  then create a new branch.  You can put your app in the examples folder

Oh no. I somehow missed this email. I will check this and get back to you.
Thank you so much.
Best,
Nidhi
On Wed, Jun 12, 2024 at 12:12 PM Ann Marie Ward @.***>
wrote:

Hi @nidhikamath2102 https://github.com/nidhikamath2102
Adam has a good video on how to do PRs here:
https://www.youtube.com/watch?v=Xth83OD3NNc
To start fork this repo
https://github.com/AnnMarieW/dash-ag-grid-examples then create a new
branch. You can put your app in the examples folder
https://github.com/AnnMarieW/dash-ag-grid-examples/tree/main/examples
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159#issuecomment-2163431138,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4BZ6HKOJTISDFAS23DZHBXP5AVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRTGQZTCMJTHA
.
You are receiving this because you were mentioned.Message ID:
@.***>

No hurry - whenever you have time works for us :slightly_smiling_face:
Let me know if you need any more information.

Hi,
Thank you for your response. I have created a pull request for this.
https://github.com/AnnMarieW/dash-ag-grid-examples/pull/3
Do let me know what needs to be done further, thanks!
Best,
Nidhi
On Thu, Jun 20, 2024 at 8:34 PM Ann Marie Ward @.***>
wrote:

No hurry - whenever you have time works for us 🙂
Let me know if you need any more information.
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159#issuecomment-2181777740,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4GYI25GL64WISNBINTZINYHRAVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBRG43TONZUGA
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi @nidhikamath2102
Thanks for the PR, but it's in the wrong repo.  So sorry - the link I provided above was incorrect :cry:
The example needs to be added here:
https://github.com/AnnMarieW/dash-app-gallery/tree/main/examples

Hi,
I have updated this and created a pull request with the latest branch. Let
me know if this is fine.
https://github.com/AnnMarieW/dash-app-gallery/pull/160
Best,
Nidhi
On Mon, Jul 1, 2024 at 10:57 AM Ann Marie Ward @.***>
wrote:

Hi @nidhikamath2102 https://github.com/nidhikamath2102
Thanks for the PR, but it's in the wrong repo. So sorry - the link I
provided above was incorrect 😢
The example needs to be added here:
https://github.com/AnnMarieW/dash-app-gallery/tree/main/examples
—
Reply to this email directly, view it on GitHub
https://github.com/AnnMarieW/dash-app-gallery/issues/159#issuecomment-2200387515,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQIM4ASZGM5Q36N6YPPFD3ZKFU5BAVCNFSM6AAAAABI7GSV32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBQGM4DONJRGU
.
You are receiving this because you were mentioned.Message ID:
@.***>


improve release process

the new algorithm:

pass release, use last vX.Y.Z as default
rebase extended branch from specific commit at passed release
add tag goimports to that commit
add last release to the head of extended branch

improved https://github.com/kamilsk/go-tools/blob/v0.1.5/Taskfile


Haste effect does not work as intended.

Hit the wrong button and did not write a description, but basically, it gives attack speed, but not breaking speed.


Allow GNP updates without re-deploying infrastructure

Right now it's impossible to update GNPs on a running cluster using lokoctl without re-deploying the control plane (for example, the user might want to change management_cidrs). The reason it's impossible is that we apply the GNP manifests using Bootkube, which isn't re-runnable.
I suggest we consider moving the GNP manifests out of the Bootkube module and apply them as a post-deployment step which always runs as part of lokoctl cluster apply. The manifests are already defined in a Helm chart.
We probably need to introduce a mechanism which allows applying arbitrary manifests/charts as part of an apply operation. One way of thinking about this functionality is "auto-applied components". It could make sense to reuse existing logic we already have for Lokomotive components for this functionality. However, things like GNPs should always be applied, so we don't want an optional component {} block for them.

See also #478.

Following offline discussions I'm not sure the description is accurate: updating GNPs isn't forcing a control plane re-deployment. Rather, re-running lokoctl cluster apply doesn't update GNPs. @invidian please correct me if I got it wrong.
In any case the bottom line is clear: it should be easy to update GNPs.


ConversationChain to Agent

Issue you'd like to raise.
Is it possible to convert a Conversation Chain into an Agent?
Suggestion:
No response

Is it necessary to provide Tools? What if I don't want to use tools?


Merge pull request #1 from alibaba/master

从spring cloud alibaba获取最新代码
Describe what this PR does / why we need it
Does this pull request fix one issue?

Describe how you did it
Describe how to verify it
Special notes for reviews

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


journeycard changes

Add allowUnseenQuery to make it possible to ask the inbox whether other convs have been joined.
Handle interactions between cards. Split checkers out so PickCard is smaller.
cc @mmaxim

CI failed on TestChatSrvDeleteConversation which looks like a chat flake. And recursively deleting a directory. I'm going to consider this to have passed.


feat: automatically configure vendor mode

When a vendor folder is seen, we need to disable the go module mode,
instead we need to use GOPATH mode. This is a simple toggle of one
env variable, using a script means that users do not need to set any
build args.
How Has This Been Tested?

I have updated my example repo to include a function using vendor and with no build args, see the jules function here https://github.com/LucasRoesler/golang-http-template-examples
How are existing users impacted? What migration steps/scripts do we need?
This will remove any manual steps to enable vendor mode in the templates, it should improve the DX
Checklist:
I have:

[x] updated the documentation and/or roadmap (if required)
[x] read the CONTRIBUTION guide
[x] signed-off my commits with git commit -s
[ ] added unit tests

out of topic, I wish long-lived patient life for those who use vscode everyday for workspaces, it really delayed my response to this PR, as well as Goland IDE (they both don't work with the workspaces in terms of IDE completion)

@LucasRoesler @MrWormHole
I think I have found the issue with #73, we seem to have assumed that @kevin-lindsay-1 is using the golang-middleware template and have examples that work with it. He's actually must be using the golang-http template.
Now, we did ask for this information and a repro several times in the issue, then yesterday what he said revealed it was actuallt the golang-http template, and not golang-middleware.
When I run Lucas' example, I am getting a cannot find package when I use this PR / template with golang-http and a vendor folder.
This is probably what Kevin is referring to when he says that an issue hasn't been fixed for 4 months.
His code sample that he sent us via Discord, will not work for the community because it always assumes a vendor folder, and we know that not everyone uses vendoring, furthermore, this PR automatically turns on vendoring whenever a vendor folder is present.
Excerpt:
WORKDIR "/usr/root"
# Copy module information
COPY [ "./function/go.sum", "./function/go.mod", "./" ]
COPY [ "./function/vendor/", "./vendor/" ]
# Precompile vendor binaries for caching purposes
RUN go build -v "./vendor/..."

Here's how I reproduced the error.
git clone https://github.com/LucasRoesler/golang-http-template-examples
cd golang-http-template-examples
faas-cli template pull https://github.com/LucasRoesler/golang-http-template#feat-automatic-vendor-detection

cd publisher
go mod vendor
cd ../

faas-cli build -f stack.yml --filter publisher

Then:
[0] > Building publisher.
Clearing temporary build folder: ./build/publisher/
Preparing: ./publisher/ build/publisher/function
Building: publisher:latest with golang-http template. Please wait..
Sending build context to Docker daemon  538.6kB
Step 1/42 : FROM --platform=${TARGETPLATFORM:-linux/amd64} ghcr.io/openfaas/of-watchdog:0.9.3 as watchdog
 ---> c8a51e4b8423
Step 2/42 : FROM --platform=${BUILDPLATFORM:-linux/amd64} golang:1.18-alpine3.15 as build
 ---> 99760761bfe0
Step 3/42 : ARG TARGETPLATFORM
 ---> Using cache
 ---> 5a5860cdcee9
Step 4/42 : ARG BUILDPLATFORM
 ---> Using cache
 ---> d4a04da5b0f2
Step 5/42 : ARG TARGETOS
 ---> Using cache
 ---> d91937f388cb
Step 6/42 : ARG TARGETARCH
 ---> Using cache
 ---> d3ad506ad823
Step 7/42 : RUN apk --no-cache add git
 ---> Using cache
 ---> ecbb40a90bfb
Step 8/42 : COPY --from=watchdog /fwatchdog /usr/bin/fwatchdog
 ---> Using cache
 ---> 7cb0e62fc206
Step 9/42 : RUN chmod +x /usr/bin/fwatchdog
 ---> Using cache
 ---> 964c43dd91fa
Step 10/42 : RUN mkdir -p /go/src/handler
 ---> Using cache
 ---> c98f4b23ac45
Step 11/42 : WORKDIR /go/src/handler
 ---> Using cache
 ---> 660395c49032
Step 12/42 : COPY . .
 ---> bbd5cfffc63c
Step 13/42 : ARG GO111MODULE="on"
 ---> Running in 920edb165b05
Removing intermediate container 920edb165b05
 ---> 31318c83cbc9
Step 14/42 : ARG GOPROXY=""
 ---> Running in 0e6a6fff0523
Removing intermediate container 0e6a6fff0523
 ---> cf4b245a873e
Step 15/42 : ARG GOFLAGS=""
 ---> Running in 6f1f0250f22c
Removing intermediate container 6f1f0250f22c
 ---> 8627a5a097a0
Step 16/42 : ARG CGO_ENABLED=0
 ---> Running in d1c2bc6bc3bd
Removing intermediate container d1c2bc6bc3bd
 ---> 3512cad1c97c
Step 17/42 : ARG DEBUG=0
 ---> Running in 1ae19016b421
Removing intermediate container 1ae19016b421
 ---> 8bc73cd713d9
Step 18/42 : ENV DEBUG=${DEBUG}
 ---> Running in 6eba586bdcc8
Removing intermediate container 6eba586bdcc8
 ---> 42fe29d9850d
Step 19/42 : ENV CGO_ENABLED=${CGO_ENABLED}
 ---> Running in abc7da9df3f8
Removing intermediate container abc7da9df3f8
 ---> c22a3eac3ff1
Step 20/42 : ENV GOOS=${TARGETOS}
 ---> Running in 74067bd9c516
Removing intermediate container 74067bd9c516
 ---> acb4ee60c870
Step 21/42 : ENV GOARCH=${TARGETARCH}
 ---> Running in 6cb85ec43621
Removing intermediate container 6cb85ec43621
 ---> b5fed88e4793
Step 22/42 : ENV GO=/go/src/handler/go.sh
 ---> Running in bc3211c95e08
Removing intermediate container bc3211c95e08
 ---> 7cbe8e9e9a2b
Step 23/42 : RUN chmod +x ${GO}
 ---> Running in 5bd5d68127a5
Removing intermediate container 5bd5d68127a5
 ---> a2f82673576f
Step 24/42 : RUN test -z "$(gofmt -l $(find . -type f -name '*.go' -not -path "./vendor/*" -not -path "./function/vendor/*"))" || { echo "Run \"gofmt -s -w\" on your Golang code"; exit 1; }
 ---> Running in 0e0c8e68e2c6
Removing intermediate container 0e0c8e68e2c6
 ---> d1cd7ef5de9f
Step 25/42 : WORKDIR /go/src/handler/function
 ---> Running in 6f29995b47c0
Removing intermediate container 6f29995b47c0
 ---> d7846c145261
Step 26/42 : RUN mkdir -p /go/src/handler/function/static
 ---> Running in 78f1f3b7ca58
Removing intermediate container 78f1f3b7ca58
 ---> 6c1fb795b7af
Step 27/42 : RUN ${GO} test ./... -cover
 ---> Running in 7aa5fdf2e3b6
Setting vendor mode env variables
?       handler/function        [no test files]
?       handler/function/pkg/version    [no test files]
Removing intermediate container 7aa5fdf2e3b6
 ---> d5acf8829571
Step 28/42 : WORKDIR /go/src/handler
 ---> Running in aae9159de83f
Removing intermediate container aae9159de83f
 ---> d54c79c00b04
Step 29/42 : RUN ${GO} build --ldflags "-s -w" -a -installsuffix cgo -o handler .
 ---> Running in 91c2734441a8
Setting vendor mode env variables
main.go:18:2: cannot find package "github.com/openfaas/templates-sdk/go-http" in any of:
        /usr/local/go/src/github.com/openfaas/templates-sdk/go-http (from $GOROOT)
        /go/src/github.com/openfaas/templates-sdk/go-http (from $GOPATH)
The command '/bin/sh -c ${GO} build --ldflags "-s -w" -a -installsuffix cgo -o handler .' returned a non-zero code: 1
[0] < Building publisher done in 7.68s.
[0] Worker done.

Total build time: 7.68s
Errors received during build:
- [publisher] received non-zero exit code from build, error: The command '/bin/sh -c ${GO} build --ldflags "-s -w" -a -installsuffix cgo -o handler .' returned a non-zero code: 1

I feel like we can remove the shell scripts, there is really nothing that will go wrong if GOFLAGs are not specified by someone else and the Go version of that person is +v1.14
Here is what I got from official docs (https://go.dev/ref/mod#build-commands)

The -mod flag controls whether go.mod may be automatically updated and whether the vendor directory is used.

-mod=mod tells the go command to ignore the vendor directory and to automatically update go.mod, for example, when an imported package is not provided by any known module.
-mod=readonly tells the go command to ignore the vendor directory and to report an error if go.mod needs to be updated.
-mod=vendor tells the go command to use the vendor directory. In this mode, the go command will not use the network or the module cache.
By default, if the go version in go.mod is 1.14 or higher and a vendor directory is present, the go command acts as if -mod=vendor were used. Otherwise, the go command acts as if -mod=readonly were used.

Technically I do go mod vendor as a separate process. I also avoid using -mod flag because go figures its own. Some common cases that go wrong
(this fails if you have a vendor folder or you don't have a vendor folder)
GO111MODULE: on
GOFLAGS: "-mod=vendor"
(this also fails if there is no vendor folder)
GO111MODULE: off
GOFLAGS: "-mod=mod"
Also as a second note, I have seen this when I opened up my IDE, I think IDEs do set -mod flag sometimes, when I created go.work file, it disappeared, all the go installations don't have global GOLAGS for -mod flag

@MrWormHole try it with the golang-http template. The middleware template has no issue at present.


Add a new GUI interface

Is your feature request related to a problem? Please describe.
We are always welcoming new features and we want someone to add a GUI interface to our keylogger
Describe the solution you'd like

It may contain an overview of the keys
It may show the current key pressed
It may have the feature to change the interval time without editing the code file itself
It make a manual clock reset button
It may make the project look cool & sci-fi ;)

Hi @anuragc2001 ,
Is it okay, if the GUI will be made using tkinter ?
If yes, Can you describe briefly about the overview of the keys, I mean do we need to show the keyboard layout in GUI or something else ?
I can implement the whole GUI part.
I have plenty of experience in tkinter, you can check my GUI projects.

go ahead


Refactor(eos_validate_state): Refactor validation-report generation

Change Summary
Change of logic to avoid writing in CSV and read from it to generate the md report
Related Issue(s)
NA
Component(s) name
arista.avd.eos_validate_state
Proposed changes

How to test

Checklist
User Checklist

N/A

Repository Checklist

[x] My code has been rebased from devel before I start
[x] I have read the CONTRIBUTING document.
[x] My change requires a change to the documentation and documentation have been updated accordingly.
[x] I have updated molecule CI testing accordingly. (check the box if not applicable)

J2 templates to validate.

I changed the validation in generate_veras in case the inventory is pushing some hosts that don't have .type defined (in my case, the inventory contained CVP)

Ansible was complaining, so removing the J2 template:
[WARNING]: conditional statements should not include jinja2 templating delimiters such as {{ }} or {% %}. Found: {{ validation_role.validation_report_md | arista.avd.default(true)
}}```


Difficulty enabling triagebot on rustup repository

We're trying to enable support for @rustbot particularly for labelling things in the Rustup repository.  We added a triagebot.toml file to the top level, but the bot seems to ignore us (e.g. https://github.com/rust-lang/rustup/issues/2733#issuecomment-829530565)
Are we missing a web hook?  If so it's not documented in the wiki :(  If not, what else can we do to help debug/enable this?
cc @Mark-Simulacrum @workingjubilee @jyn514

triagebot needs to be added to the permissions; I've done so now and updated the wiki to reflect this. Thanks!


11 Input

A short chapter before we bite off the next big chunk.
We have OUTPUT statements to display text, now we implement INPUT to take in text.
Parsing condition:
https://github.com/nyjc-computing/pseudo/blob/7fa5f74e5efc3fe5937b6288d16b23d745cac42b/parser.py#L289-L290
And parser implementation:
https://github.com/nyjc-computing/pseudo/blob/150cfaa75c5ad2d4b712a1d3001ef51f570b6635/parser.py#L125-L132

Resolving
An INPUT statement looks like:
INPUT Variable

This assigns the string entered by the user to Variable. Since there are not get expressions used here, we don't really need to do any frame insertion.
However, at minimum we do need to check that Variable has been declared:
https://github.com/nyjc-computing/pseudo/blob/f6a00fe1c218cc9e53d92ea76f6a6cc874d348f2/resolver.py#L43-L46

Interpreting INPUT statements
Finally, the implementation. Since this takes in user input and assigns it to the given variable, we draw our inspiration for interpreting from assignStmt():
https://github.com/nyjc-computing/pseudo/blob/57340bc80db02e796d7a66a2dcbb28ccc8d46e55/interpreter.py#L25-L27

Testing
After fixing a missing argument, our test code successfully runs:
DECLARE Result : STRING
OUTPUT "Enter some text: "
INPUT Result
OUTPUT "You entered: ", Result

Result:
Enter some text:
Hi
You entered: Hi


grpc-json: added support for ignoring query parameters

Description:
Allow grpc-json transcoder to ignore a set of specified query parameters. The most common use case would be api key parameter. This change allows request like /shelves/456/books/123?key=API_KEY to be transcoded
Risk Level: Low
Testing: Unit tests are added.
Docs Changes: Updated
Release Notes: Updated
Fixes #5281

@lizan could you review this change?

@kh-chang you may need to run docs/build.sh to update the doc files.

Thanks for reviewing!


PHOENIX-6187   Avoid swallowing UPSERT... ON DUPLICATION KEY UPDATE failures

See above comments

@gjacoby126 Sorry for the late turn around. Please take a look.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 10s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  1s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

+1 :green_heart:
mvninstall
14m 38s
master passed

+1 :green_heart:
compile
1m  0s
master passed

+1 :green_heart:
checkstyle
0m 45s
master passed

+1 :green_heart:
javadoc
0m 48s
master passed

+0 :ok:
spotbugs
3m  8s
phoenix-core in master has 966 extant spotbugs warnings.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
9m 12s
the patch passed

+1 :green_heart:
compile
0m 55s
the patch passed

+1 :green_heart:
javac
0m 55s
the patch passed

-1 :x:
checkstyle
0m 46s
phoenix-core: The patch generated 23 new + 887 unchanged - 5 fixed = 910 total (was 892)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
javadoc
0m 47s
the patch passed

+1 :green_heart:
spotbugs
3m 22s
the patch passed

_ Other Tests _

-1 :x:
unit
162m  7s
phoenix-core in the patch failed.

+1 :green_heart:
asflicense
0m 24s
The patch does not generate ASF License warnings.

201m 32s

Reason
Tests

Failed junit tests
phoenix.end2end.join.SubqueryUsingSortMergeJoinIT

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/phoenix/pull/921

Optional Tests
dupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile

uname
Linux 719fb8347180 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev/phoenix-personality.sh

git revision
master / f1a0860

Default Java
Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08

checkstyle
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/1/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt

unit
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/1/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt

Test Results
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/1/testReport/

Max. process+thread count
6156 (vs. ulimit of 30000)

modules
C: phoenix-core U: phoenix-core

Console output
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/1/console

versions
git=2.7.4 maven=3.3.9 spotbugs=4.1.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 14s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

+1 :green_heart:
mvninstall
14m 40s
master passed

+1 :green_heart:
compile
1m  2s
master passed

+1 :green_heart:
checkstyle
0m 45s
master passed

+1 :green_heart:
javadoc
0m 48s
master passed

+0 :ok:
spotbugs
3m  9s
phoenix-core in master has 966 extant spotbugs warnings.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
9m 19s
the patch passed

+1 :green_heart:
compile
0m 58s
the patch passed

+1 :green_heart:
javac
0m 58s
the patch passed

-1 :x:
checkstyle
0m 46s
phoenix-core: The patch generated 22 new + 887 unchanged - 5 fixed = 909 total (was 892)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
javadoc
0m 47s
the patch passed

+1 :green_heart:
spotbugs
3m 20s
the patch passed

_ Other Tests _

-1 :x:
unit
159m 24s
phoenix-core in the patch failed.

+1 :green_heart:
asflicense
0m 22s
The patch does not generate ASF License warnings.

199m  0s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/2/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/phoenix/pull/921

Optional Tests
dupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile

uname
Linux 98e822388ab6 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev/phoenix-personality.sh

git revision
master / f1a0860

Default Java
Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08

checkstyle
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/2/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt

unit
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/2/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt

Test Results
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/2/testReport/

Max. process+thread count
6114 (vs. ulimit of 30000)

modules
C: phoenix-core U: phoenix-core

Console output
https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-921/2/console

versions
git=2.7.4 maven=3.3.9 spotbugs=4.1.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.


Some queries regarding the paper

Congratulations on the paper and thank you for this exciting tool.
I would be highly obliged if you could answer some queries.
I would like to use the program for my own data but I wanted to replicate some of your workflows in the paper:

Model:The link to the model trained appear dysfunctional - no data is found following the link.
Which cells/data are included in the model: Could you provide the xls table for the data included so that I can find out if the model might just work for my data.
Reprex: Is there a reproducibility repository or do you have some notebooks for the workflows you used in the paper (specifically I am interesting in Fig3 and Fig4 (Interpolating timestamps or spatial coordinates to fill gaps and Pre-training UniCoord model with cell atlas data for analyzing disease-related cells) which I would to follow for my own data.
Model parameter explanation: some help regarding the model parameters e.g. genes_used, n_cont, n_diff, n_clus, min_obs
Thank you once again,
shobhit

Dear Shobhit,
Thank you for your kind words and for showing interest in our work! I’m happy to address your queries:

Dysfunctional Model Link: I’ve checked the original link and found it to be non-functional. To resolve this, I have uploaded all the models, along with the data used for training, to Figshare. You can access them here: https://figshare.com/account/projects/229041/articles/27896874. This should also address your second query.

Reproducibility Repository: All the code required to reproduce the results from the paper is available in the GitHub repository. Please let me know if you encounter any difficulties while navigating or using the code.

Using Gene x Cells Matrix: We have experimented with both highly variable genes (HVG) and the entire gene matrix. Based on our findings, we recommend using HVG for better performance. However, ensure that your data is transformed to a log scale before proceeding.

I hope this helps! Feel free to reach out if you have additional questions or need further assistance with the workflows. Wishing you all the best with your research!
Best regards,
Haoxiang


api-haproxy: change to docker library haproxy img

Now that we use internal haproxy httpchk, we do not need the custom
image we made.

Build SUCCESS, see build http://<IP_ADDRESS>:8080/job/dev-tools/320/


Fix: several minor bugs

Signed-off-by: Somefive<EMAIL_ADDRESS>Description of your changes

Support using "vela/ql" in Workflow.
Add comments to ListApplicationResourceTrackers.
Fix op.#List namespace parameter bug.
Add application labels to resources dispatched by kube.#Apply, otherwise they cannot be recycled.

I have:

[x] Read and followed KubeVela's contribution process.
[x] Run make reviewable to ensure this PR is ready for review.
[x] Added backport release-x.y labels to auto-backport this PR if necessary.

How has this code been tested

Special notes for your reviewer

cherry-pick?


Document time for leader election and lease acquisition

From @nvanbenschoten:

Leases expire in a maximum of 9 seconds, with an average expected time of 4.5 seconds. I’d round up to 10 seconds to give time for the actual leader election and lease acquisition. This does seem like something we should document.

Need to find the right place(s):

https://www.cockroachlabs.com/docs/v20.1/architecture/replication-layer.html#raft
https://www.cockroachlabs.com/docs/v20.1/architecture/replication-layer.html#leases

Question on this from our community slack:

One more question. Knowing that CRDB uses Raft for replication, when a CRDB instance is killed, a new leader should be elected really fast (probably udner a second), but what i'm observing is that it takes around 10-15 seconds for the cluster to go back to working well. Is that normal and what are the reasons for such a time needed for the cluster to go back to normal state?
Can the Raft elect time be configured?

Leases expire in 9s, but raft elections use a randomized timeout of up to double that, so there's a worst case of 18s before we start the election. And then the leader election itself takes (i think) 4-5 network round trips on top of that, but I'd call that out separately instead of just "rounding" to give a worst-case time to recovery of 20s.

Fixed by #10917


Foldable and Traversable instances for ANum

Thanks for the great package! :)  Just adding these instances because I've found them to be useful when using ANum, let me know if you think they are in the spirit of the library!

Thanks for the PR! Note that this has been released now as ANum-<IP_ADDRESS>