Do not accept new blocks？

I ran our advanced example, but the program always stops receiving new blocks after running for a while. Can you help me figure out this issue?

The progress blocks indicate the remote is still performing work on the server to process your request and should send you data when the next sequential segment of 1000 blocks will be ready.
Sometimes it happens that some segment of takes more time than other to complete (multiple 1000 chunks are running on the server) and it can seems that the stream is stuck but it's not the case completely.
I know we had overload traffic over the weekend due to some memory allocations, that could also explain why some segments where taking longer than expected.
Can you try now and check again?

The progress blocks indicate the remote is still performing work on the server to process your request and should send you data when the next sequential segment of 1000 blocks will be ready.
Sometimes it happens that some segment of takes more time than other to complete (multiple 1000 chunks are running on the server) and it can seems that the stream is stuck but it's not the case completely.
I know we had overload traffic over the weekend due to some memory allocations, that could also explain why some segments where taking longer than expected.
Can you try now and check again?

First, thank you for your clarification. This issue still occurs, especially with real-time data, and such situations can cause some delay. What can I do on my side to minimize the occurrence of similar issues? Currently, I am using a free key; would upgrading to a paid version improve this situation?

Sometimes, there's no response for up to an hour, making me suspect that the program might have crashed.

thank you for your clarification. This issue still occurs, especially with real-time data

Real-time it should be different as the usually the chunking happens only for historical segments not for live segment.

there's no response for up to an hour

Ok that long usually indicate a problem with the Substreams. Within this hour, do you still see progress block rate continuing or it goes to 0?
Could you share longer logs that I could examine further?

感谢您的澄清。此问题仍然存在，尤其是实时数据

实时情况应该有所不同，因为分块通常仅发生在历史段而不是实时段。

长达一小时没有回复

好的，那么长时间通常表示子流存在问题。在这一小时内，您是否仍看到进度块率继续下降或降至 0？
您能否分享更长的日志以供我进一步检查？

"severity":"DEBUG","timestamp":"2024-12-04T01:29:01.796472578Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:02.339984483Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285077000,"stop_block":285078000,"duration_ms":6546614},{"start_block":285069000,"stop_block":285070000,"duration_ms":8548232},{"start_block":285245000,"stop_block":285246000,"duration_ms":912161},{"start_block":285255000,"stop_block":285256000,"duration_ms":449865},{"start_block":285171000,"stop_block":285172000,"duration_ms":3782165},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4065913},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16423764},{"start_block":285253000,"stop_block":285254000,"duration_ms":688634},{"start_block":285264000,"stop_block":285265000,"duration_ms":5069},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1580953}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355012,"total_processing_time_ms":89363291,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355012,"total_processing_time_ms":108082629,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355012,"total_processing_time_ms":88673082,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355012,"total_processing_time_ms":4517541,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355012,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":307335042490}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:02.340042791Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:02.847477604Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285264000,"stop_block":285265000,"duration_ms":5576},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1581460},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4066420},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16424271},{"start_block":285253000,"stop_block":285254000,"duration_ms":689141},{"start_block":285245000,"stop_block":285246000,"duration_ms":912668},{"start_block":285255000,"stop_block":285256000,"duration_ms":450372},{"start_block":285171000,"stop_block":285172000,"duration_ms":3782672},{"start_block":285077000,"stop_block":285078000,"duration_ms":6547121},{"start_block":285069000,"stop_block":285070000,"duration_ms":8548739}],"modules_stats":[{"name":"map_pools_created","total_processed_block_count":355012,"total_processing_time_ms":88673082,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355012,"total_processing_time_ms":4517541,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355012,"highest_contiguous_block":285020000},{"name":"map_token_metadata","total_processed_block_count":355012,"total_processing_time_ms":89363291,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355012,"total_processing_time_ms":108082629,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":307335042490}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:02.84753471Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:03.397885061Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285245000,"stop_block":285246000,"duration_ms":913219},{"start_block":285255000,"stop_block":285256000,"duration_ms":450923},{"start_block":285171000,"stop_block":285172000,"duration_ms":3783223},{"start_block":285077000,"stop_block":285078000,"duration_ms":6547671},{"start_block":285069000,"stop_block":285070000,"duration_ms":8549290},{"start_block":285264000,"stop_block":285265000,"duration_ms":6127},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1582010},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4066971},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16424821},{"start_block":285253000,"stop_block":285254000,"duration_ms":689692}],"modules_stats":[{"name":"sol:blocks_without_votes","total_processed_block_count":355012,"highest_contiguous_block":285020000},{"name":"map_token_metadata","total_processed_block_count":355012,"total_processing_time_ms":89363327,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355012,"total_processing_time_ms":108082685,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355012,"total_processing_time_ms":88673129,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355012,"total_processing_time_ms":4517543,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":307335042490}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:03.39794195Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:03.94443664Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285069000,"stop_block":285070000,"duration_ms":8549836},{"start_block":285245000,"stop_block":285246000,"duration_ms":913765},{"start_block":285255000,"stop_block":285256000,"duration_ms":451469},{"start_block":285171000,"stop_block":285172000,"duration_ms":3783769},{"start_block":285077000,"stop_block":285078000,"duration_ms":6548218},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16425368},{"start_block":285253000,"stop_block":285254000,"duration_ms":690238},{"start_block":285264000,"stop_block":285265000,"processed_blocks":18,"duration_ms":6673},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1582557},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4067517}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355030,"total_processing_time_ms":89363871,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355030,"total_processing_time_ms":108083338,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355030,"total_processing_time_ms":88673624,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355030,"total_processing_time_ms":4517590,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355030,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:03.944488326Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:04.460169527Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16425883},{"start_block":285253000,"stop_block":285254000,"duration_ms":690754},{"start_block":285264000,"stop_block":285265000,"processed_blocks":29,"duration_ms":7189},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1583073},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4068033},{"start_block":285069000,"stop_block":285070000,"duration_ms":8550352},{"start_block":285245000,"stop_block":285246000,"duration_ms":914281},{"start_block":285255000,"stop_block":285256000,"duration_ms":451985},{"start_block":285171000,"stop_block":285172000,"duration_ms":3784285},{"start_block":285077000,"stop_block":285078000,"duration_ms":6548733}],"modules_stats":[{"name":"sol:blocks_without_votes","total_processed_block_count":355041,"highest_contiguous_block":285020000},{"name":"map_token_metadata","total_processed_block_count":355041,"total_processing_time_ms":89364212,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355041,"total_processing_time_ms":108083780,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355041,"total_processing_time_ms":88673952,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355041,"total_processing_time_ms":4517608,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:04.460221361Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:05.013828515Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285069000,"stop_block":285070000,"duration_ms":8550906},{"start_block":285245000,"stop_block":285246000,"duration_ms":914835},{"start_block":285255000,"stop_block":285256000,"duration_ms":452539},{"start_block":285171000,"stop_block":285172000,"duration_ms":3784839},{"start_block":285077000,"stop_block":285078000,"duration_ms":6549287},{"start_block":285253000,"stop_block":285254000,"duration_ms":691307},{"start_block":285264000,"stop_block":285265000,"processed_blocks":38,"duration_ms":7743},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1583626},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4068587},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16426437}],"modules_stats":[{"name":"sol:blocks_without_votes","total_processed_block_count":355050,"highest_contiguous_block":285020000},{"name":"map_token_metadata","total_processed_block_count":355050,"total_processing_time_ms":89364505,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355050,"total_processing_time_ms":108084214,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355050,"total_processing_time_ms":88674214,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355050,"total_processing_time_ms":4517632,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:05.013879414Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:05.532243343Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16426956},{"start_block":285253000,"stop_block":285254000,"duration_ms":691826},{"start_block":285264000,"stop_block":285265000,"processed_blocks":55,"duration_ms":8261},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1584145},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4069105},{"start_block":285069000,"stop_block":285070000,"duration_ms":8551424},{"start_block":285245000,"stop_block":285246000,"duration_ms":915353},{"start_block":285255000,"stop_block":285256000,"duration_ms":453057},{"start_block":285171000,"stop_block":285172000,"duration_ms":3785357},{"start_block":285077000,"stop_block":285078000,"duration_ms":6549805}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355067,"total_processing_time_ms":89364936,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355067,"total_processing_time_ms":108084790,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355067,"total_processing_time_ms":88674577,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355067,"total_processing_time_ms":4517661,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355067,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:05.532294855Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:06.047682934Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285077000,"stop_block":285078000,"duration_ms":6550321},{"start_block":285069000,"stop_block":285070000,"duration_ms":8551940},{"start_block":285245000,"stop_block":285246000,"duration_ms":915868},{"start_block":285255000,"stop_block":285256000,"duration_ms":453573},{"start_block":285171000,"stop_block":285172000,"duration_ms":3785873},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16427471},{"start_block":285253000,"stop_block":285254000,"duration_ms":692341},{"start_block":285264000,"stop_block":285265000,"processed_blocks":70,"duration_ms":8777},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1584660},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4069621}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355082,"total_processing_time_ms":89365270,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355082,"total_processing_time_ms":108085285,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355082,"total_processing_time_ms":88674894,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355082,"total_processing_time_ms":4517681,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355082,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:06.047734373Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"INFO","timestamp":"2024-12-04T01:29:06.406024805Z","logger":"sol-tracker","message":"substreams stream stats","data_msg_rate":"0.000 msg/s (4879 total)","progress_block_rate":"26.033 block/s (355094 total)","undo_msg_rate":"0.000 msg/s (0 total)","progress_last_block":{"stage 0":285264070},"progress_running_jobs":{"stage 0":10},"progress_total_processed_blocks":355094,"progress_last_contiguous_block":{"stage 0":285264000},"last_block":"#285019996 (FXPDJW6jJCtEd8xQhBps4VHajkUo4PzfkWWkvmJkaHKJ)","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:06.551675385Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16427975},{"start_block":285253000,"stop_block":285254000,"duration_ms":692845},{"start_block":285264000,"stop_block":285265000,"processed_blocks":86,"duration_ms":9281},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1585164},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4070125},{"start_block":285069000,"stop_block":285070000,"duration_ms":8552444},{"start_block":285245000,"stop_block":285246000,"duration_ms":916373},{"start_block":285255000,"stop_block":285256000,"duration_ms":454077},{"start_block":285171000,"stop_block":285172000,"duration_ms":3786377},{"start_block":285077000,"stop_block":285078000,"duration_ms":6550825}],"modules_stats":[{"name":"sol:blocks_without_votes","total_processed_block_count":355098,"highest_contiguous_block":285020000},{"name":"map_token_metadata","total_processed_block_count":355098,"total_processing_time_ms":89365624,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355098,"total_processing_time_ms":108085697,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355098,"total_processing_time_ms":88675218,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355098,"total_processing_time_ms":4517699,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:06.551727876Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:07.062600695Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4070634},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16428484},{"start_block":285253000,"stop_block":285254000,"duration_ms":693354},{"start_block":285264000,"stop_block":285265000,"processed_blocks":95,"duration_ms":9790},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1585673},{"start_block":285171000,"stop_block":285172000,"duration_ms":3786886},{"start_block":285077000,"stop_block":285078000,"duration_ms":6551334},{"start_block":285069000,"stop_block":285070000,"duration_ms":8552953},{"start_block":285245000,"stop_block":285246000,"duration_ms":916882},{"start_block":285255000,"stop_block":285256000,"duration_ms":454586}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355107,"total_processing_time_ms":89365935,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355107,"total_processing_time_ms":108086124,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355107,"total_processing_time_ms":88675486,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355107,"total_processing_time_ms":4517717,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355107,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:07.062653212Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:07.561056416Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285069000,"stop_block":285070000,"duration_ms":8553453},{"start_block":285245000,"stop_block":285246000,"duration_ms":917382},{"start_block":285255000,"stop_block":285256000,"duration_ms":455086},{"start_block":285171000,"stop_block":285172000,"duration_ms":3787386},{"start_block":285077000,"stop_block":285078000,"duration_ms":6551835},{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16428985},{"start_block":285253000,"stop_block":285254000,"duration_ms":693855},{"start_block":285264000,"stop_block":285265000,"processed_blocks":106,"duration_ms":10290},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1586174},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4071134}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355118,"total_processing_time_ms":89366270,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355118,"total_processing_time_ms":108086590,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355118,"total_processing_time_ms":88675836,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355118,"total_processing_time_ms":4517737,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355118,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:07.561109639Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:08.095193648Z","logger":"sol-tracker","message":"received response Progress","progress":{"Progress":{"running_jobs":[{"start_block":285020000,"stop_block":285021000,"processed_blocks":963,"duration_ms":16429489},{"start_block":285253000,"stop_block":285254000,"duration_ms":694359},{"start_block":285264000,"stop_block":285265000,"processed_blocks":122,"duration_ms":10794},{"start_block":285216000,"stop_block":285217000,"processed_blocks":999,"duration_ms":1586678},{"start_block":285156000,"stop_block":285157000,"processed_blocks":62,"duration_ms":4071638},{"start_block":285069000,"stop_block":285070000,"duration_ms":8553957},{"start_block":285245000,"stop_block":285246000,"duration_ms":917886},{"start_block":285255000,"stop_block":285256000,"duration_ms":455590},{"start_block":285171000,"stop_block":285172000,"duration_ms":3787890},{"start_block":285077000,"stop_block":285078000,"duration_ms":6552339}],"modules_stats":[{"name":"map_token_metadata","total_processed_block_count":355134,"total_processing_time_ms":89366779,"highest_contiguous_block":285020000},{"name":"map_spl_token","total_processed_block_count":355134,"total_processing_time_ms":108087206,"highest_contiguous_block":285020000},{"name":"map_pools_created","total_processed_block_count":355134,"total_processing_time_ms":88676243,"highest_contiguous_block":285020000},{"name":"basic_database_out","total_processed_block_count":355134,"total_processing_time_ms":4517765,"highest_contiguous_block":285020000},{"name":"sol:blocks_without_votes","total_processed_block_count":355134,"highest_contiguous_block":285020000}],"stages":[{"modules":["sol:blocks_without_votes","map_token_metadata","map_spl_token","map_pools_created","basic_database_out"],"completed_ranges":[{"start_block":284902000,"end_block":285020000},{"start_block":285021000,"end_block":285069000},{"start_block":285070000,"end_block":285077000},{"start_block":285078000,"end_block":285156000},{"start_block":285157000,"end_block":285171000},{"start_block":285172000,"end_block":285216000},{"start_block":285217000,"end_block":285245000},{"start_block":285246000,"end_block":285253000},{"start_block":285254000,"end_block":285255000},{"start_block":285256000,"end_block":285264000}]}],"processed_bytes":{"total_bytes_read":308355234343}}},"logging.googleapis.com/labels":{}} {"severity":"DEBUG","timestamp":"2024-12-04T01:29:08.095249729Z","logger":"sol-tracker","message":"substreams waiting to receive message","cursor":"7omEobyHXQ2rdTGU1UHYP6WwLpc_DFhnUAvkIxhIg4GAmBKxp_qgWhsGLGiEmOGRhWerCF7Kpo6XTxsk9qAa6oqNpOMisFtjFwNX6YPs87Hvefr7MAwRB9MCK5DpZIKhKHiiNgKzG-lyoJbjXIuIPRlXPcNGZjDo6FgL5NguK_Jpwgk=","logging.googleapis.com/labels":{}}
This is a segment of historical data, where no data has been pushed for an hour, only progress data. I will provide the real-time data once it becomes available.

I haven't encountered any issues so far. Both the historical and real-time data are running smoothly and executing as expected. I'm not sure if there has been an upgrade by the team or if there have been updates to the service. Yesterday, both the historical and real-time segments experienced long-term blocking, and a restart was required to recover. Unfortunately, I didn't have progress logs enabled at that time. I've now added the logs, so I will observe for another day and hope everything goes well. Lastly, thank you for your answers and assistance.

I will provide the logs when this issue occurs with real-time data

Yeah try to include the latest traceID you receive, it is printed on re-connection. With the trace ID, we can correlate with logs from the backend system and investigate further.

Yesterday, both the historical and real-time segments experienced long-term blocking, and a restart was required to recover

This is not the expected service we want to offer, let us know as soon as it happens so we can check what is wrong.

I'm not sure if there has been an upgrade by the team or if there have been updates to the service

We did some performance improvements to some area of the backend system to reduce the average load the server(s) need to work with.

(Side question of my own)

Do you correctly save and restore the cursor you receive in your HandleBlockScopeData? This is important as it will resume the stream where the process left off the last time.

Ok good.
Keep me posted. I'm going to close this issue. Feel free to reach on Discord (https://discord.gg/jZwqxJAvRs) too, might be easier to live discussion.


Add Github PR resource

This PR adds the github-pr-resource resource type to the list.

Someone with write access needs to merge 😅

Well, I could swear I merged it, but Github disagrees 😁
https://github.com/concourse/resource-types/commit/81c35d8e928df800048565a446bcfb3b12bc56b1

The commit has already made it to the live website https://resource-types.concourse-ci.org
looks like Github is having some problems, will just close the PR.


Document MMCM config bits for Artix-7

@emka what is the status of this one? I see some commits related to this issue in your fork. Can you write a few words here what you already did?

I correlated the CLKOUT_DIVIDE bits, the first one is merged and I found the others to behave identical. After the last christmas break I made no further progress unfortunately.

Status update: There are two fuzzers related to MMCM and the CMT_TOP_[LR]_LOWER_B tile:

MMCM features: https://github.com/SymbiFlow/prjxray/tree/master/fuzzers/031-cmt-mmcm
Tile PIPs: https://github.com/SymbiFlow/prjxray/tree/master/fuzzers/034b-cmt-mmcm-pips

These solve most of MMCM bits required to use it.

I've created a separate issue to track documenting bits for advanced features of MMCM: https://github.com/SymbiFlow/prjxray/issues/1473

Superseded by #1473.

Superseded by #1473.


[Feature] For images, show some basic image metadata

It would be nice if, for images, the panel would display:

Image size: 1600 × 1200 pixels
Image DPI: 72 pixels/inch

This comes from https://forum.obsidian.md/t/image-size-in-images-pop-up-explorer/43909

Fix coming in the next release (1.3).  It doesn't show DPI (printer spec) or PPI, but does show pixel width/height.


Endurable fan: AnimationContainer component

http://endurable-fan.glitch.me/#StoryAnimationContainer
I think the docs might be confusing for this section.

:rocket: PR was released in v0.19.0 :rocket:


When turning on S3 and juicebox I can no run the enduro command.

After setting up s3 and setting juicebox to true, i run enduro on the project and this is the message i receive:
┌————————————————————~—setting up s3—~—————————————————————┐
? Input your s3 key ********************
? Input your s3 secret key ****************************************
? What is the s3 bucket name? attic-records
? select s3 region eu-west-1
? Enable juicebox Yes
├——————————————————————————————————————————————————————————┤
│ s3 set successfully                                      │
└——————————————————————————————————————————————————————————┘
fsconlt8155:test jordan.melendez$ enduro

┌————————————————————~—Enduro started—~————————————————————┐
│ Development server started at:                           │
│     localhost:3000                                       │

│ Admin ui available at:                                   │
│     localhost:5000/admin                                 │
├——————————————————————————————————————————————————————————┤
│ Admin has no live-reload!                                │
└——————————————————————————————————————————————————————————┘
[11:12:54 | +    1.36] developer start

┌——————————————————————~—Juice pull—~——————————————————————┐
fsconlt8155:test jordan.melendez$

Note before i setup s3 the enduro function did run when juicbox was turned on. Am I missing a step that isn't documented yet?

Yea, thats not good. Could you please update to newest enduro by running npm i enduro -g. I added some more error info recently. Let me know if this doesn't help.

Yeah I ran the update and still no luck. It sets up s3 and juicebox fine but then when running enduro to start the project it hangs up.
Jordans-iMac-2:test jordanmelendez$ enduro

┌————————————————————~—Enduro started—~————————————————————┐
│ Development server started at:                           │
│     localhost:3000                                       │
│ Admin ui available at:                                   │
│     localhost:5000/admin                                 │
├——————————————————————————————————————————————————————————┤
│ Admin has no live-reload!                                │
└——————————————————————————————————————————————————————————┘
[09:47:43 | +    1.16] developer start

┌——————————————————————~—Juice pull—~——————————————————————┐
Jordans-iMac-2:test jordanmelendez$

I am sorry you are having this issue. I added some general logging to juicebox, could you please update enduro again and see if it prints anything out?

Ok so just ran it again this is the error that shows up.
┌——————————————————————~—Juice pull—~——————————————————————┐
<?xml version="1.0" encoding="UTF-8"?>
<Error>NoSuchKey<Message>The specified key does not exist.</Message><Key>juicebox/juice.json</Key><RequestId>D9D7C1AFA915E83C</RequestId><HostId>ZVCgqQ7Ui4089BrVrprR1pE89MSBcXnqsVySuFbvQP/zhDGZzZyWvd23GRVdYdLZXTl6lt4tgSE=</HostId></Error>
Jordans-iMac-2:test jordanmelendez$

I actually think i've gotten it to work properly. I added the response argument to the log statement you just added in which told me i had to run enduro juice pack -f first. Which worked.

Hey, good job. It's still a bug, I will take a look at it. Glad it works for you though

I hear yah. Thanks for the help though. Other than that enduro is solid, loving it so far.


ImageData Constructor error on old Chromium

Once you hit Chrome 38 and below - there is an error with ColorTexture

This makes it so any colored rectangles don't work.

Weirdly ImageData is supposed to be there on Chrome 36
https://developer.mozilla.org/en-US/docs/Web/API/ImageData/ImageData

Interestingly, L2 doesn't create an ImageData for that - just raw bytes:
https://github.com/rdkcentral/Lightning/blob/dev/src/textures/RectangleTexture.mjs#L30

It might be that older versions like Chrome 36 relied on createImageData on the 2d context instead of new ImageData ? Hence its throwing a constructor error?
Might need to fall back to using canvas.getContext('2d').createImageData() instead of new ImageData() directly?

No @wouterlucas this happens in ColorTexture, where a single pixel texture is created.

Ah I see - sorry the stack is kinda weird and imageData threw me off, here?
https://github.com/lightning-js/renderer/blob/main/src/core/textures/ColorTexture.ts#L67
I guess this was around the time they where still working on Typed Arrays with the introduction of ES5 and maybe the Uint8ClampedArray is buggy or not fully implemented in v36? Or ImageData might have issues with whatever v36 is returning as a clamped array.
I'd have to follow the L2 code a little more but does changing that to a Uint8Array change anything?
Could always manually clamp it, though that would be horrible in performance 😅 for the test:
function createClampedArray(data) {
  let clampedArray = new Uint8Array(data.length);
  for (let i = 0; i < data.length; i++) {
    clampedArray[i] = Math.max(0, Math.min(255, data[i])); // Manual clamping
  }
  return clampedArray;
}

or just return a white pixel like L2 does and see if the error goes away to pin point it

circling back to this one, MDN is actually technically correct and incorrect that Chrome 36+ does has a ImageData constructor. It's correct that there is indeed a ImageData object but on Chrome 38 you can't instantiate it. Regardless of what parameters you give new ImageData() it always returns illegal constructor 🤣  and I've tried everything.
On top of that you can't create uint arrays with an iterable in the constructor, changed Textures/ColorTexture in #449 to use an Uint8Array directly avoiding ImageData all together.
I'll run some tests today, bit curious if this also shaves off a little on the benchmarks. As I'd imagine creating an ImageData object is a little heavier then allocating a Uin8Array and this is used extensively for textures.


Minimal desktop

This rips out most desktop functionality in favor of exposing the REST API via a simple tray app. Notifications should still show up using the os notifications, and there are tools to access features of the running daemon. Also re-enables desktop releases, and changes the underlying cors lib we're using to something better maintained and powerful, but simpler to use. Comments will be added inline shortly.

Once that passes, this is GTG @sanderpick!


Style guide

Is there a style guide?  I dont see anything under "contributing" or anywhere I've looked in the docs, maybe I'm not looking in the right place?
If there's not, maybe adopt an existing modern style guide, something like google's, or one for c++ and one for java.
For example:
https://google.github.io/styleguide/cppguide.html
https://google.github.io/styleguide/javaguide.html

Another great idea. 👍
I thought a little about this. Some of the companies around here enforce style by running a lint or uncrustify on code on check in. But that has to be new code only, I don't want to touch older code just yet...
It's just you and me changing code so far, so I'll read over the style guides and let's choose one.

I think anything that a bigger organization / open-source project is using is good.  People have worked through this issue and have put a lot of effort into figuring out reasonable things, just have to pick one and stick with it. And document it.
should also cover python for all the scons code.
and tcl.
and magical.


microburst analysis

add in automatic microburst analysis that logs the information to a textfile / csv file. this allows NE to monitor each port and check  for potential packet drop conditions.

actually already have a tool for detection, completely forgot about this
https://github.com/fmadio/pcap_microburst

updated and release as bpf_counter
https://github.com/fmadio/pcap_bpfcounter
released as gen1/gen2 plugin architecture system


test(v6): reproduce custom environment preload injection

Description

base https://github.com/vitejs/vite/pull/16471/

@patak-dev I tested alpha.5 in https://github.com/hi-ogawa/vite-environment-examples/pull/51 and it looks like __vitePreload is now injected for custom environment with ssr: true, which wasn't the case in alpha.3.
For now I added a failing test here as you might notice something. I start to read the new builder code, so I might going to find something myself.
It looks like per-environment resolveConfigToBuild is not including environmentOptions from the root config:
https://github.com/vitejs/vite/blob/37190afc150fea4ec4586db2cef69d1f084fa224/packages/vite/src/node/build.ts#L1511

Thanks @hi-ogawa! Added a comment here to explain the issues. I'll be reworking our internal plugins to avoid accessing config.build next so we can simplify this patching. This explains why you had issues initially with the way we were handling the environment config during build and you needed to pre-merge the environment options into the config to make things work.

Thanks for the quick fix! Confirmed alpha.6 is working on my repo https://github.com/hi-ogawa/vite-environment-examples/pull/51


[Netty] Failed in the runtime

After upgrade to version 3.7.1 catch the error during the launch. The error appears after choose simulation and fill description.
I tried to do this:

change different JDKs (8, 11)
get demo project and launch there

Error log:
computerdatabase.BasicSimulation is the only simulation, executing it.
Select run description (optional)

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x0000000133fb11f2, pid=1636, tid=5635
#
# JRE version: OpenJDK Runtime Environment AdoptOpenJDK-11.0.11+9 (11.0.11+9) (build 11.0.11+9)
# Java VM: OpenJDK 64-Bit Server VM AdoptOpenJDK-11.0.11+9 (11.0.11+9, mixed mode, tiered, compressed oops, g1 gc, bsd-amd64)
# Problematic frame:
# C  [libnetty_tcnative_osx_x86_6417779003216119739014.dylib+0x1671f2]  __isPlatformOrVariantPlatformVersionAtLeast.cold.1+0x152
#
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /Users/pavelbairov/IdeaProjects/gatling-maven-plugin-demo-scala/hs_err_pid1636.log
#
# If you would like to submit a bug report, please visit:
#   https://github.com/AdoptOpenJDK/openjdk-support/issues
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

Process finished with exit code 134 (interrupted by signal 6: SIGABRT)

And there is full log
hs_err_pid1636.log
As you can see from the log, the problem is somewhere in the netty library itself...

Weird, I don't have any issue.
% uname -a
Darwin Stephanes-MacBook-Pro 20.5.0 Darwin Kernel Version 20.5.0: Sat May  8 05:10:33 PDT 2021; root:xnu-7195.121.3~9/RELEASE_X86_64 x86_64

% java -version
openjdk version "1.8.0_312"
OpenJDK Runtime Environment (Zulu <IP_ADDRESS>-CA-macosx) (build 1.8.0_312-b07)
OpenJDK 64-Bit Server VM (Zulu <IP_ADDRESS>-CA-macosx) (build 25.312-b07, mixed mode)

Could you please try a different OpenJDK build than the ones from AdoptOpenJDK, eg Zulu?
If you still experience an issue, please provide your uname -a and your java -version.

No issue either with Java 11:
% java -version
openjdk version "11.0.13" 2021-10-19 LTS
OpenJDK Runtime Environment Zulu11.52+13-CA (build 11.0.13+8-LTS)
OpenJDK 64-Bit Server VM Zulu11.52+13-CA (build 11.0.13+8-LTS, mixed mode)

Nor Java 17:
% java -version
openjdk version "17.0.1" 2021-10-19 LTS
OpenJDK Runtime Environment Zulu17.30+15-CA (build 17.0.1+12-LTS)
OpenJDK 64-Bit Server VM Zulu17.30+15-CA (build 17.0.1+12-LTS, mixed mode, sharing)

uname -a
Darwin bairov.local 19.0.0 Darwin Kernel Version 19.0.0: Thu Oct 17 16:17:15 PDT 2019; root:xnu-6153.41.3~29/RELEASE_X86_64 x86_64

I tried Zulu. Also Corretto, AdoptOpenJDK

Something strange. Ok, I will try JDK 17 and then maybe try to update my OS

Yeah, your MacOS version is pretty old, that could be the issue.

Still, if that fixes your issue, it might be worth reporting it to Netty.

Great!


Big http download upgrade#26717

PR for Big HTTP Download - Upgrade
The PR #26719 must be closed. All updates to code reviews were moved here also.
Fixes #26717

Form @pfalcon in #26719:
Thanks for the patches. They definitely make this sample more complicated, but I'm not sure they improve it. Please keep in mind that this a sample, not a wget implementation or something. Its purpose is to show that it's possible to write simple, POSIX-compatible applications for Zephyr. Specifically:
This sample should be simple for user to study (the less code the better, or at least "more code" is not an improvement).
This sample should be simple, and small, and thus run on as many device as possible (usage of floating-point arithmetic is specifically avoided).
This sample should be buildable on a standard POSIX system (e.g. Linux) using make -f Makefile.posix, and this should be achieved with as few #ifdef's in the source code as possible (so, adding more isn't a good direction).
I think that this patch in its current shape deteriorates the sample on all the points above.
Looking just at the functionality, I agree that showing download speed would be useful. As I mentioned elsewhere, the reason I didn't add it myself is, well, because the figures which come out aren't exactly to brag about :-I. And then, there're multiple download speeds - e.g. averaged over all iterations, averaged over the current iteration, instantaneous (i.e. averaged over small period of time, 3-5s). IMHO, the most useful for Zephyr testing would be the last.

Hey @pfalcon thank you for your answer.

Form @pfalcon in #26719:
Thanks for the patches. They definitely make this sample more complicated, but I'm not sure they improve it. Please keep in mind that this a sample, not a wget implementation or something. Its purpose is to show that it's possible to write simple, POSIX-compatible applications for Zephyr. Specifically:
This sample should be simple for user to study (the less code the better, or at least "more code" is not an improvement).

Why showing KiB and MiB makes the sample complicated? There are only three additional defines and some couple of strings needed.

This sample should be simple, and small, and thus run on as many device as possible (usage of floating-point arithmetic is specifically avoided).

I agree with it. Floating point arithmetic were removed.
The sample is also a way far from being wget ;)

This sample should be buildable on a standard POSIX system (e.g. Linux) using make -f Makefile.posix, and this should be achieved with as few #ifdef's in the source code as possible (so, adding more isn't a good direction).

Currently POSIX is not possible to compile due to absence of the header mbedtls/md.h. Please try to compile for POSIX.
Why so scary about #ifdef's?

I think that this patch in its current shape deteriorates the sample on all the points above.

I do not agree: see my explanations above and the less amount of code needed for my improvements.

Looking just at the functionality, I agree that showing download speed would be useful. As I mentioned elsewhere, the reason I didn't add it myself is, well, because the figures which come out aren't exactly to brag about :-I. And then, there're multiple download speeds - e.g. averaged over all iterations, averaged over the current iteration, instantaneous (i.e. averaged over small period of time, 3-5s). IMHO, the most useful for Zephyr testing would be the last.

Ok. Then I can add the averaged speed.
If you completely disagree with my improvements, please write it here and I will not invest my time in this upgrade anymore. Otherway please test the improved sample and give me a feedback/review on needed changes.

samples: net: sockets: big_http_download: add progress metrics

I don't think this commit message correctly describes the change. The matter, the was progress metrics already. You added more to them, or extended them, then please write just that: "samples: net: sockets: big_http_download: Extend progress metrics".

samples: net: sockets: big_http_download: add progress metrics

I don't think this commit message correctly describes the change. The matter, the was progress metrics already. You added more to them, or extended them, then please write just that: "samples: net: sockets: big_http_download: Extend progress metrics".

Ok. Will do it.

Dear all. With this push I kept the changes as small as possible and also improved all suggested parts. For me the upgrade looks very good now. I hope you enjoy the possible last review :D


Cant get grab-all-posters.py to run

Output:
Plex/grab-all-posters.py: line 1: import: command not found
Plex/grab-all-posters.py: line 2: import: command not found
Plex/grab-all-posters.py: line 3: import: command not found
Plex/grab-all-posters.py: line 4: import: command not found
Plex/grab-all-posters.py: line 5: import: command not found
Plex/grab-all-posters.py: line 6: import: command not found
Plex/grab-all-posters.py: line 7: import: command not found
from: too many arguments
from: too many arguments
from: too many arguments
from: too many arguments
from: too many arguments
from: too many arguments
Plex/grab-all-posters.py: line 15: import: command not found
Plex/grab-all-posters.py: line 16: import: command not found
Plex/grab-all-posters.py: line 17: import: command not found
Plex/grab-all-posters.py: line 18: import: command not found
Plex/grab-all-posters.py: line 19: import: command not found
from: too many arguments
from: too many arguments
Plex/grab-all-posters.py: line 22: syntax error near unexpected token `('
Plex/grab-all-posters.py: line 22: `from helpers import (booler, get_all_from_library, get_ids, get_letter_dir, get_plex, has_overlay, get_size, redact, validate_filename, load_and_upgrade_env)'

ENV:
# PLEX API ENV VARS
PLEXAPI_PLEXAPI_TIMEOUT='360'
PLEXAPI_AUTH_SERVER_BASEURL=http://XXXXXXXXXXX:32400
                                             # Just the base URL, no /web or anything at the end.
                                             # i.e. http://<IP_ADDRESS>:32400 or the like
PLEXAPI_AUTH_SERVER_TOKEN=XXXXXXXXXXX
PLEXAPI_LOG_BACKUP_COUNT='3'
PLEXAPI_LOG_FORMAT='%(asctime)s %(module)12s:%(lineno)-4s %(levelname)-9s %(message)s' # PLEX API ENV VARS
PLEXAPI_LOG_LEVEL='INFO'
PLEXAPI_LOG_PATH='plexapi.log'
PLEXAPI_LOG_ROTATE_BYTES='512000'
PLEXAPI_LOG_SHOW_SECRETS='false'

# GENERAL ENV VARS
TMDB_KEY=XXXXXXXXXXX# https://developers.themoviedb.org/3/getting-started/introduction
TVDB_KEY=XXXXXXXXXXX# currently not used; https://thetvdb.com/api-information
DELAY=0                                      # optional delay between items
LIBRARY_NAMES=All Movies, 4K Movies          # comma-separated list of libraries to act on

# IMAGE DOWNLOAD ENV VARS
## what-to-grab
GRAB_SEASONS=1                               # should get-all-posters retrieve season posters?
GRAB_EPISODES=1                              # should get-all-posters retrieve episode posters? [requires GRAB_SEASONS]
GRAB_BACKGROUNDS=1                           # should get-all-posters retrieve backgrounds?
ONLY_CURRENT=1                               # should get-all-posters retrieve ONLY current artwork?
ARTWORK=1                                    # current background is downloaded with current poster
INCLUDE_COLLECTION_ARTWORK=1                 # should get-all-posters retrieve collection posters?
ONLY_COLLECTION_ARTWORK=0                    # should get-all-posters retrieve ONLY collection posters?
#ONLY_THESE_COLLECTIONS=                      # only grab artwork for these collections and items in them
POSTER_DEPTH=0                               # grab this many posters [0 grabs all]
KEEP_JUNK=0                                  # keep files that script would normally delete [incorrect filetypes, mainly]

## where-to-put-it
USE_ASSET_NAMING=1                           # should grab-all-posters name images to match PMM's Asset Directory requirements?
USE_ASSET_FOLDERS=1                          # should those PMM-Asset-Directory names use asset folders?
USE_ASSET_SUBFOLDERS=0                       # create asset folders in subfolders ["Collections", "Other", or [0-9, A-Z]] ]
ASSETS_BY_LIBRARIES=0                        # should those PMM-Asset-Directory images be sorted into library folders?
ASSET_DIR=/mnt/Media01B/Plex-Meta-Manager/config/assets    # top-level directory for those PMM-Asset-Directory images
#V-- Ignored                                 # if asset-directory naming is on, the next three are ignored
#POSTER_DIR=extracted_posters                 # put downloaded posters here
#CURRENT_POSTER_DIR=current_posters           # put downloaded current posters and artwork here
#POSTER_CONSOLIDATE=0                         # if false, posters are separated into folders by library

## tracking
TRACK_URLS=1                                 # If set to 1, URLS are tracked and won't be downloaded twice
TRACK_COMPLETION=0                           # If set to 1, movies/shows are tracked as complete by rating id
TRACK_IMAGE_SOURCES=1                        # keep a file containing file names and source URLs

## general
POSTER_DOWNLOAD=0                            # if true, generate a script rather than downloading
FOLDERS_ONLY=0                               # Just build out the folder hierarchy; no image downloading
DEFAULT_YEARS_BACK=0                         # in absence of a "last run date", grab things added this many years back.
                                             # 0 means "grab everything"
THREADED_DOWNLOADS=0                         # should downloads be done in the background in threads?
RESET_LIBRARIES=                             # reset "last time" count to 0 for these libraries
RESET_COLLECTIONS=                           # CURRENTLY UNUSED
ADD_SOURCE_EXIF_COMMENT=1                    # CURRENTLY UNUSED

# STATUS ENV VARS
PLEX_OWNER=jwaltrip4                         # account name of the server owner
TARGET_PLEX_URL=http://XXXXXXXXXXX:32400  # As above, the target of apply_all_status
TARGET_PLEX_TOKEN=XXXXXXXXXXX# As above, the target of apply_all_status
TARGET_PLEX_OWNER=jwaltrip4                  # As above, the target of apply_all_status
LIBRARY_MAP={"LIBRARY_ON_PLEX":"LIBRARY_ON_TARGET_PLEX", ...}
                                             # In apply_all_status, map libraries according to this JSON.

# RESET-POSTERS ENV VARS
TRACK_RESET_STATUS=1                         # should reset-posters-* keep track of status and pick up where it left off?
LOCAL_RESET_ARCHIVE=1                        # should reset-posters-tmdb keep a local archive of posters?
TARGET_LABELS=                               # comma-separated list of labels to reset posters on
REMOVE_LABELS=0                              # attempt to remove the TARGET_LABELs from items after resetting the poster
RESET_SEASONS=1                              # reset-posters-* resets season artwork as well in TV libraries
RESET_EPISODES=1                             # reset-posters-* resets episode artwork as well in TV libraries [requires RESET_SEASONS=True]
RETAIN_RESET_STATUS_FILE=0                   # Don't delete the reset progress file at the end
FLUSH_STATUS_AT_START=0                      # Delete the reset progress file at the start instead of reading it
RESET_SEASONS_WITH_SERIES=0                  # If there isn't a season poster, use the series poster
DRY_RUN=0                                    # [currently only works with reset-posters-*]; don't actually do anything, just log

# DELETE_COLLECTION ENV VARS
KEEP_COLLECTIONS=                            # List of collections to keep

# REMATCH-ITEMS ENV VARS
UNMATCHED_ONLY=1                             # If 1, only rematch things that are currently unmatched

# RESET_ADDED_AT
ADJUST_DATE_FUTURES_ONLY=0                   # Only look at items that show up as added in the future
ADJUST_DATE_EPOCH_ONLY=1                     # Only adjust items that have "originally available" dates of `1970-01-01`

# REFRESH_METADATA
REFRESH_1970_ONLY=1                          # If 1, only refresh things that have an originally-available date of 1970-01-01

# ACTOR ENV VARS
CAST_DEPTH=20                                # how deep to go into the cast for actor collections
TOP_COUNT=10                                 # how many actors to export
ACTORS_ONLY=0                                # ignore cast members who are not primarily known as actors

What is the command you are using to attempt to run the script?

I think that was it.   Cant test further until tomorrow

Gettingthis error at the top:
/usr/lib/python3/dist-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (2.0.7) or chardet (3.0.4) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "

what version of python is this?  Are you running this in a venv?  Can you provide the output of:
python --version

and
python -m pip freeze

3.8
Sent from my Verizon, Samsung Galaxy smartphone
Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Chaz Larson @.>
Sent: Friday, December 29, 2023 12:34:11 AM
To: chazlarson/Media-Scripts @.>
Cc: James W Waltrip IV @.>; Author @.>
Subject: Re: [chazlarson/Media-Scripts] Cant get grab-all-posters.py to run (Issue #22)
what version of python is this? Are you running this in a venv? Can you provide the output of:
python --version
and
python -m pip freeze
—
Reply to this email directly, view it on GitHubhttps://github.com/chazlarson/Media-Scripts/issues/22#issuecomment-1871741927, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADVZGBXQF6NN4PZNXHHE63LYLZI5HAVCNFSM6AAAAABBF4N72OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZRG42DCOJSG4.
You are receiving this because you authored the thread.Message ID: @.***>

Not running VENV on this.  should I?
Python 3.8.10
python -m pip freeze
about-time==4.2.1
acme==1.1.0
alive-progress==3.1.5
anyio==4.0.0
async-timeout==4.0.3
asyncclick==<IP_ADDRESS>
asyncio==3.4.3
attrs==19.3.0
Automat==0.8.0
bernhard==0.2.6
blinker==1.4
bottle==0.12.25
cassandra-driver==3.28.0
certbot==0.40.0
certbot-apache==0.39.0
certifi==2019.11.28
cfgv==3.4.0
chardet==3.0.4
chevron==0.14.0
cinemagoer==2023.5.1
Click==7.0
cloud-init==23.3.3
colorama==0.4.3
command-not-found==0.3
ConfigArgParse==0.13.0
configobj==5.0.6
configshell-fb==1.1.25
constantly==15.1.0
CouchDB==1.2
cryptography==2.8
cupshelpers==1.0
dbus-python==1.2.16
defer==1.0.6
defusedxml==0.7.1
distlib==0.3.8
distro==1.4.0
distro-info==0.23+ubuntu1.1
dnspython==1.16.0
docker==4.1.0
elastic-transport==8.4.1
elasticsearch==8.10.1
entrypoints==0.3
exceptiongroup==1.1.3
filelock==3.13.1
filetype==1.2.0
future==0.18.2
geomet==0.2.1.post1
Glances==<IP_ADDRESS>
gpg==1.13.1
grapheme==0.6.0
graphitesender==0.11.2
greenlet==3.0.3
httplib2==0.14.0
hyperlink==19.0.0
identify==2.5.33
idna==2.8
ifaddr==0.2.0
IMDbPY==2022.7.9
importlib-metadata==1.5.0
incremental==16.10.1
influxdb==5.3.1
influxdb-client==1.38.0
Jinja2==2.10.1
josepy==1.2.0
jsonpatch==1.22
jsonpointer==2.0
jsonschema==3.2.0
kafka-python==2.0.2
keyring==18.0.1
language-selector==0.1
launchpadlib==1.10.13
lazr.restfulclient==0.14.2
lazr.uri==1.0.3
libvirt-python==6.1.0
linecache2==1.0.0
lxml==4.9.4
macaroonbakery==1.3.1
Markdown==3.1.1
MarkupSafe==1.1.0
meson==0.53.2
mock==3.0.5
more-itertools==4.2.0
msgpack==1.0.7
netifaces==0.10.4
nodeenv==1.8.0
oauthlib==3.1.0
packaging==20.3
paho-mqtt==1.6.1
parsedatetime==2.4
pathvalidate==3.2.0
pbkdf2==1.3
pbr==5.4.5
pexpect==4.6.0
piexif==1.1.3
pika==1.3.2
Pillow==10.1.0
platformdirs==4.1.0
PlexAPI==4.15.7
ply==3.11
potsdb==1.0.3
pre-commit==3.5.0
prometheus-client==0.17.1
protobuf==3.6.1
psutil==5.9.6
py3nvml==0.2.7
pyasn1==0.4.2
pyasn1-modules==0.2.1
pycairo==1.16.2
pycrypto==2.6.1
pycryptodomex==3.19.0
pycups==1.9.73
pydantic==1.10.13
pygal==3.0.0
Pygments==2.3.1
PyGObject==3.36.0
PyHamcrest==1.9.0
PyICU==2.4.2
PyJWT==1.7.1
pymacaroons==0.13.0
pymdstat==0.4.3
pymongo==4.5.0
PyNaCl==1.3.0
pyOpenSSL==19.0.0
pyparsing==2.4.6
PyQt5==5.14.1
pyRFC3339==1.1
pyrsistent==0.15.5
pyserial==3.4
pysmi==0.3.4
pysnmp==4.4.12
python-apt==2.0.1+ubuntu<IP_ADDRESS>
python-augeas==0.5.0
python-dateutil==2.8.2
python-debian==0.1.36+ubuntu1.1
python-dotenv==1.0.0
python-kasa==0.5.3
pytz==2019.3
pyudev==0.21.0
PyYAML==5.3.1
pyzmq==25.1.1
reactivex==4.0.4
requests==2.22.0
requests-toolbelt==0.8.0
requests-unixsocket==0.2.0
rtslib-fb==2.1.71
ruamel.yaml==0.18.5
ruamel.yaml.clib==0.2.8
scandir==1.10.0
SecretStorage==2.3.1
service-identity==18.1.0
simplejson==3.16.0
sip==4.19.21
six==1.14.0
sniffio==1.3.0
sos==4.5.6
SQLAlchemy==2.0.24
ssh-import-id==5.10
statsd==4.0.1
systemd-python==234
tabulate==0.9.0
targetcli-fb==2.1.51
testresources==2.0.0
tmdbapis==1.2.2
tmdbsimple==2.9.1
tmdbv3api==1.9.0
traceback2==1.4.0
tvdb-v4-official==1.1.0
Twisted==18.9.0
typing-extensions==4.8.0
ubuntu-advantage-tools==8001
ubuntu-drivers-common==0.0.0
ujson==5.8.0
unattended-upgrades==0.1
unittest2==1.1.0
urllib3==2.0.7
urwid==2.0.1
validators==0.22.0
virtualenv==20.25.0
wadllib==1.3.3
websocket-client==0.53.0
wifi==0.3.8
xkit==0.0.0
xmltodict==0.13.0
zeroconf==0.119.0
zipp==1.0.0
zope.component==4.3.0
zope.event==4.4
zope.hookable==5.0.0
zope.interface==4.7.1

I  would generally recommend running python scripts in venvs to keep the setup clean.  You're using an older version of requests than I am, which seems odd since other things are newer.
I haven't tried this with 3.8 in some time.  I'll give it a try to see if there's some issue there.

I will switch to a VENV

What version of Python should I be using?  I have a multi version set up.

I just created a new venv using Python 3.8.18, installed requirements, script ran fine.

I will switch to a VENV
Also... is this error why the assets folder is not being populated? Or have I left something out of the .env file?

The script doesn't appear to be running successfully, so I wouldn't expect anything to get downloaded.

Can you confirm my issue with assets folder not populated?  I assume with the .env file I have, it should populate, correct?

OK....  Still not working, still same error at top.
Here is script
sudo update-alternatives --set python3 /usr/bin/python3.8
cd /mnt/Media01B/Media-Scripts
sudo python3 -m venv pmm-venv
source pmm-venv/bin/activate
cd Plex
sudo python3 grab-all-posters.py
deactivate
sudo update-alternatives --set python3 /usr/bin/python3.8

I have run requirements.txt in both the Media-Scripts folder, and the Plex subfolder
Here is the screen output
/usr/lib/python3/dist-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (2.0.7) or chardet (3.0.4) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
Starting grab-all-posters 0.8.1 at 2023-12-29 11:12:43
================== ATTENTION ==================
Downloading disabled; file identification not possible
Script will default to .jpg extension on all images
================== ATTENTION ==================
Threaded downloads: False
connecting to http://<IP_ADDRESS>:32400...
Loading All Movies ...
Resetting rundate for All Movies to 2023-12-29 11:12:43.617273...
getting collections from [All Movies]...
209 collection(s) retrieved...
Grab Collection Posters |████████████████████████████████████████| 209/209 [100%] in 22.4s (9.35/s)
Loading movies  ...
Completed loading 2500 of 2258 movie(s) from All Movies
Grab all posters All Movies |███▍                                    | ▂▂▄ 208/2500 [8%] in 3:21 (1.0/s, eta: 36:53)

assets folder is creaated under config, but nothing is in it.

Hmmm... changed
POSTER_DOWNLOAD=0
to
POSTER_DOWNLOAD=1
and now it is downloading.

That seems to be behaving as expected.
Did you install the requirements into the venv?  I cannot reproduce this with python 3.8.18:
/usr/lib/python3/dist-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (2.0.7) or chardet (3.0.4) doesn't match a supported version!

Yes I did...  ran from both Media-Scripts folder and Media-Scripts/Plex folder
Will send output from both as soon as run completes.

Output 1:
(pmm-venv) jwaltrip@plex-media-svr2:/mnt/Media01B/Media-Scripts$ sudo pip install -r requirements.txt
/usr/bin/pip:6: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
  from pkg_resources import load_entry_point
Requirement already satisfied: alive-progress==2.4.1 in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 1)) (2.4.1)
Requirement already satisfied: imdbpy in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 2)) (2022.7.9)
Requirement already satisfied: pathvalidate in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 3)) (3.2.0)
Requirement already satisfied: PlexAPI in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 4)) (4.15.7)
Requirement already satisfied: pre-commit in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 5)) (3.5.0)
Requirement already satisfied: pyopenssl in /usr/lib/python3/dist-packages (from -r requirements.txt (line 6)) (19.0.0)
Requirement already satisfied: python-dotenv in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 7)) (1.0.0)
Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from -r requirements.txt (line 8)) (2.22.0)
Requirement already satisfied: ruamel.yaml in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 9)) (0.18.5)
Requirement already satisfied: tmdbapis in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 10)) (1.2.2)
Requirement already satisfied: tmdbsimple in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 11)) (2.9.1)
Requirement already satisfied: tmdbv3api in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 12)) (1.9.0)
Requirement already satisfied: tvdb_v4_official in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 13)) (1.1.0)
Requirement already satisfied: piexif in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 14)) (1.1.3)
Requirement already satisfied: filetype in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 15)) (1.2.0)
Requirement already satisfied: sqlalchemy<2.0 in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 16)) (1.4.50)
Requirement already satisfied: tabulate in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 17)) (0.9.0)
Requirement already satisfied: validators in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 18)) (0.22.0)
Requirement already satisfied: about-time==3.1.1 in /usr/local/lib/python3.8/dist-packages (from alive-progress==2.4.1->-r requirements.txt (line 1)) (3.1.1)
Requirement already satisfied: grapheme==0.6.0 in /usr/local/lib/python3.8/dist-packages (from alive-progress==2.4.1->-r requirements.txt (line 1)) (0.6.0)
Requirement already satisfied: cinemagoer in /usr/local/lib/python3.8/dist-packages (from imdbpy->-r requirements.txt (line 2)) (2023.5.1)
Requirement already satisfied: cfgv>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from pre-commit->-r requirements.txt (line 5)) (3.4.0)
Requirement already satisfied: identify>=1.0.0 in /usr/local/lib/python3.8/dist-packages (from pre-commit->-r requirements.txt (line 5)) (2.5.33)
Requirement already satisfied: nodeenv>=0.11.1 in /usr/local/lib/python3.8/dist-packages (from pre-commit->-r requirements.txt (line 5)) (1.8.0)
Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3/dist-packages (from pre-commit->-r requirements.txt (line 5)) (5.3.1)
Requirement already satisfied: virtualenv>=20.10.0 in /usr/local/lib/python3.8/dist-packages (from pre-commit->-r requirements.txt (line 5)) (20.25.0)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7; platform_python_implementation == "CPython" and python_version < "3.13" in /usr/local/lib/python3.8/dist-packages (from ruamel.yaml->-r requirements.txt (line 9)) (0.2.8)
Requirement already satisfied: greenlet!=0.4.17; python_version >= "3" and (platform_machine == "aarch64" or (platform_machine == "ppc64le" or (platform_machine == "x86_64" or (platform_machine == "amd64" or (platform_machine == "AMD64" or (platform_machine == "win32" or platform_machine == "WIN32")))))) in /usr/local/lib/python3.8/dist-packages (from sqlalchemy<2.0->-r requirements.txt (line 16)) (3.0.3)
Requirement already satisfied: lxml in /usr/local/lib/python3.8/dist-packages (from cinemagoer->imdbpy->-r requirements.txt (line 2)) (4.9.4)
Requirement already satisfied: setuptools in /usr/local/lib/python3.8/dist-packages (from nodeenv>=0.11.1->pre-commit->-r requirements.txt (line 5)) (68.2.2)
Requirement already satisfied: distlib<1,>=0.3.7 in /usr/local/lib/python3.8/dist-packages (from virtualenv>=20.10.0->pre-commit->-r requirements.txt (line 5)) (0.3.8)
Requirement already satisfied: filelock<4,>=3.12.2 in /usr/local/lib/python3.8/dist-packages (from virtualenv>=20.10.0->pre-commit->-r requirements.txt (line 5)) (3.13.1)
Requirement already satisfied: platformdirs<5,>=3.9.1 in /usr/local/lib/python3.8/dist-packages (from virtualenv>=20.10.0->pre-commit->-r requirements.txt (line 5)) (4.1.0)

Output 2:
'''
(pmm-venv) jwaltrip@plex-media-svr2:/mnt/Media01B/Media-Scripts/Plex$ sudo pip install -r requirements.txt
/usr/bin/pip:6: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
from pkg_resources import load_entry_point
Requirement already satisfied: PlexAPI in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 1)) (4.15.7)
Requirement already satisfied: tmdbapis in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 2)) (1.2.2)
Requirement already satisfied: tmdbv3api in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 3)) (1.9.0)
Requirement already satisfied: python-dotenv in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 4)) (1.0.0)
Requirement already satisfied: tvdb_v4_official in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 5)) (1.1.0)
Requirement already satisfied: ruamel.yaml in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 6)) (0.18.5)
Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from -r requirements.txt (line 7)) (2.22.0)
Requirement already satisfied: pathvalidate in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 8)) (3.2.0)
Requirement already satisfied: imdbpy in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 9)) (2022.7.9)
Requirement already satisfied: alive_progress in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 10)) (2.4.1)
Requirement already satisfied: piexif in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 11)) (1.1.3)
Requirement already satisfied: filetype in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 12)) (1.2.0)
Requirement already satisfied: pillow in /usr/local/lib/python3.8/dist-packages (from -r requirements.txt (line 13)) (10.1.0)
Requirement already satisfied: ruamel.yaml.clib>=0.2.7; platform_python_implementation == "CPython" and python_version < "3.13" in /usr/local/lib/python3.8/dist-packages (from ruamel.yaml->-r requirements.txt (line 6)) (0.2.8)
Requirement already satisfied: cinemagoer in /usr/local/lib/python3.8/dist-packages (from imdbpy->-r requirements.txt (line 9)) (2023.5.1)
Requirement already satisfied: about-time==3.1.1 in /usr/local/lib/python3.8/dist-packages (from alive_progress->-r requirements.txt (line 10)) (3.1.1)
Requirement already satisfied: grapheme==0.6.0 in /usr/local/lib/python3.8/dist-packages (from alive_progress->-r requirements.txt (line 10)) (0.6.0)
Requirement already satisfied: SQLAlchemy in /usr/local/lib/python3.8/dist-packages (from cinemagoer->imdbpy->-r requirements.txt (line 9)) (1.4.50)
Requirement already satisfied: lxml in /usr/local/lib/python3.8/dist-packages (from cinemagoer->imdbpy->-r requirements.txt (line 9)) (4.9.4)
Requirement already satisfied: greenlet!=0.4.17; python_version >= "3" and (platform_machine == "aarch64" or (platform_machine == "ppc64le" or (platform_machine == "x86_64" or (platform_machine == "amd64" or (platform_machine == "AMD64" or (platform_machine == "win32" or platform_machine == "WIN32")))))) in /usr/local/lib/python3.8/dist-packages (from SQLAlchemy->cinemagoer->imdbpy->-r requirements.txt (line 9)) (3.0.3)

It's apparently seeing that those are already installed globally, so creating the venv after the initial install of those requirements isn't doing anything.
Were it happening to me I would delete the venv, then remove those packages from the system, then create the venv, then install requirements into the venv.

OK....
As to removing the packages from the system....  How do I do that?
https://stackoverflow.com/questions/11248073/how-do-i-remove-all-packages-installed-by-pip  <== ??
Also..  I seem to have a bunch of requirements installed globally....  I assume maybe I dont want to remove all?  How do I know I wont be removing something outside of the realm of the scripts like this?

Doing a little more research I'm not sure why it's seeing those since the default behavior these days should be to hide the system packages.  ¯_(ツ)_/¯
As far as uninstalling, yes, that's how you'd do that.
As far as uninstalling things that are used by other scripts, that's really down to what other python scripts you're using.  The simplest way to find out would be to uninstall all packages and see what breaks. when you run the other python scripts you are using, then put those scripts into venvs of their own.
I run all python in venvs and install nothing on the host, so haven't needed to deal with that in a very long time.

I'm also using pyenv and direnv to manage this stuff, so somewhat different to your setup.

thanks for the reply.... one of the problems I see is that some python stuff is not obvious......   Some of the applications will  use it, but unless you look under the hood, you dont see it.
I will try removing all of the requirements, and see what explodes outside of the obvious stuff I i know about.
Heh, I just reinstalled the server from scratch due to Python issues....  On the other hand, I have at this point a well documented install so recovery only takes a day end to end.
I am also shifting scripts and the like to a VM to keep bare metal as simple as possible.

Closing due to no activity.  Reopen if this continues to be an issue.


Tree not worked Vue 3.2.37

Vue3 3.2.37
Tree not worked. No errors
Nodes not expsnded/collapsed

are u using composition api? if so, try to use options api

I wrote my own tree. thanks


New C API wrenCopySlot()

In short, we need a C function to copy one slot to another, not matter what it contains. The implementation in C is straightforward.
Why?
Because setters, that's why.
Setters should return their argument in order to keep Wren assignment semantics. See https://github.com/wren-lang/wren-cli/issues/54 for a broader explanation.
Setters not always know their arguments. For foreign setters to be correctly implemented, we need now to switch the wrenGetSlotType() and use the appropriate method. Ugh. A wrenCopySlot() will be much better.

Argumentation is wrong, setters should always returns this, and it is the default case. But there is a real potential usage because sometime you need to create an object and conserve/copy some slots to populate the created object, before returning the created object.
Instead of a single item copy, I would go wrenCopySlots(int dstSlot, int srcSlot, size_t size) instead.
There is also a potential need for 2 functions to transfer the stack to/from an object. It can be required when creating/unwinding objects.

I agree with your argument, but don't agree with your thought about setters. It is very confusing if a = 1 returns 1 but a.b = 1 returns a. Also that means that anyway, we need to change (almost) all setters in Wren and the CLI - in the CLI they're one-line, and in the VM it's even explicit when they return their 2nd argument. I covered them one by one - all of them do the same.

I rethought about it, and was wrong, and you are almost right. Strictly
speaking, it should returns the value held, which is usually the value
passed. But there might be cases were the value is transformed, and it
should returns that value instead.

@mhermier I completely agree, and that was I meant. I'll edit to clarify. The reason I haven't mentioned this is that in the cases the value is transformed, we don't need the new API 😄.

Another motivation, thanks to cagey from discord: Passing an instance to Wren function. The instance has been returned by the constructor in slot 0, but has to be put in another slot.


Uninstalling YouTube-dl from Big Sur Mac OS X

Checklist

[x] I'm asking a question
[x] I've looked through the README and FAQ for similar questions
[x] I've searched the bugtracker for similar questions including closed ones

Question
Hello, I'm not computer-savvy and so I had no idea how to install this in the first place and now I need a fresh start. I tried installing YouTube-dl through curl, HomeBrew, and Wget (which I also installed). Installing YouTube-dl through so many channels was a mistake and so I want to completely uninstall it and just install through Homebrew. Could someone please direct me on how to uninstall/remove curl, HomeBrew, Wget, and YouTube-dl from my computer so I can properly install it? Thank you for your help in advance.

@AudibleImagery
Can you point to the installation process you followed? If you followed the INSTALLATION section of the README.md, curl and wget should yield the same results with one effectively overwriting the other. In either case, invoke rm /usr/local/bin/youtube-dl to remove the application.
What is the output of which youtube-dl on your machine?

@AudibleImagery
Can you point to the installation process you followed? If you followed the INSTALLATION section of the README.md, curl and wget should yield the same results with one effectively overwriting the other. In either case, invoke rm /usr/local/bin/youtube-dl to remove the application.
What is the output of which youtube-dl on your machine?

Hi Amit,
Here are the guides I followed/places I copied code from and pasted into Terminal:
https://formulae.brew.sh/formula/youtube-dl
https://techwiser.com/how-to-install-youtube-dl-on-mac/
http://ytdl-org.github.io/youtube-dl/download.html
I also followed your instructions and invoked "rm /usr/local/bin/youtube-dl".
When I enter "which youtube-dl" in Terminal I get the following message: youtube-dl not found
Regards,
John

http://ytdl-org.github.io/youtube-dl/download.html
https://techwiser.com/how-to-install-youtube-dl-on-mac/

as @amitjethani explained.
https://formulae.brew.sh/formula/youtube-dl

you can online on how to uninstall homebrew packages.

http://ytdl-org.github.io/youtube-dl/download.html
https://techwiser.com/how-to-install-youtube-dl-on-mac/

as @amitjethani explained.
https://formulae.brew.sh/formula/youtube-dl

you can search online on how to uninstall homebrew packages.

Okay, I'm going to follow the installation steps on the Homebrew website that you linked. I'll let you know how it goes.

http://ytdl-org.github.io/youtube-dl/download.html
https://techwiser.com/how-to-install-youtube-dl-on-mac/

as @amitjethani explained.
https://formulae.brew.sh/formula/youtube-dl

you can search online on how to uninstall homebrew packages.

I uninstalled the YouTube-dl Homebrew and now I'm going to reinstall it. I'll let you know if I have any trouble.

http://ytdl-org.github.io/youtube-dl/download.html
https://techwiser.com/how-to-install-youtube-dl-on-mac/

as @amitjethani explained.
https://formulae.brew.sh/formula/youtube-dl

you can search online on how to uninstall homebrew packages.

I installed via Homebrew and am trying to download a video. I'm getting the following error message
@MacBook-Pro ~ % youtube-dl https://www.youtube.com/watch?v=1UREfJfUm5Q
zsh: no matches found: https://www.youtube.com/watch?v=1UREfJfUm5Q


trim fileversions and archive using MS365 Archive

new sample showing how to trim fileversions and then archive the Site using M365 archive

Hi @kasperbolarsen - thank you for the awesome sample, it was a bit tricky to merge, think your or fork is out of date. Anyway this should be going live shortly 🎉😁


Error specifiying template that only defines a job

I tried to use the code snippet (copy/paste) defined for  # File: templates/jobs.yml  and got an error "Unexpected value 'jobs'"  When I add the stages and stage keyword it works (as below).     "Much like steps, jobs can be reused with templates." implies stages aren't necessary, am I missing something?
Thanks for your help.
File: templates/jobs.yml
stages:

stage:
jobs:

job: Build
steps:

script: npm install

job: Test
steps:

script: npm test

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6724abea-bbdc-bf66-ed5e-3214fa6c3e66
Version Independent ID: 4f8dab21-3f0e-da32-cc0e-1d85c13c0065
Content: Templates - Azure Pipelines
Content Source: docs/pipelines/process/templates.md
Product: devops
Technology: devops-cicd
GitHub Login: @juliakm
Microsoft Alias: jukullam

Hey  @juliakm, do you have/know of an example of a working pipeline that calls on a templated job?

@timothies, you're seeing an error because you're trying to start a job at the stage level. In test-templates-pipeline.yml, you specify stages: on line 15. This means that the next items must be stages, not jobs. That's why working-jobs.yml works and why broken-jobs.yml doesn't work. In working-jobs.yml, you specify a stage that contains a job. This is what stages: in test-templates-pipeline.yml is expecting.
If you want a template that only specifies a job, you need to change line 15 in test-templates-pipeline.yml from stages: to jobs:.
Or, you have to do the following:
stages:
  - template: templates/working-jobs.yml
  - stage:
    jobs:
      - template: templates/broken-jobs.yml

Ahh I understand - thanks @Slooz I feel like a goose but really appreciate your help.  Thank you very much!!


PLUGIN-170-Datastore-auth-update

Added: Ability to provide Service Account type as JSON for Datastore Plugins
JIRA: Jira Ticket: https://issues.cask.co/browse/PLUGIN-170

Please squash commits after addressing the minor comment.

fixed and squashed


uppdate certificates/tasks/main.yml

changing file mode on /etc/pki/CA/ca.cert
consul user did not have access to the cert with 600 root:root access set
Hi, thank you for your contribution to Mantl! Before we can accept any code into
master, we need it to meet the following criteria. If there are any you can't
satisfy yourself, go ahead and open the pull request anyway and we'll help you
test. Feel free to delete this message once you're done. Thanks again!

[ ] Installs cleanly on a fresh build of most recent master branch
[ ] Upgrades cleanly from the most recent release
[ ] Updates documentation relevant to the changes

okej


New release info screen logic (EXPOSUREAPP-4591)

This PR adds the logic behind the new release info screen.
How to test:

Start by installing an older version of the app.

Install the new app with this branch.

Upon opening the app the New Release info screen should show up.

Pressing "Weiter" or the "X" button will take you to the home screen.

Closing the app and opening it again should not show the New Release screen anymore.

By going to the menu on the top right of the home screen -> App-Information, a new entry "Neue Funktionen" should be visible at the bottom of the list. Tapping it should open the New Release screen.

Pressing "Weiter" or the "X" button will take you back to the App-Information screen.

Try deleting the app data and do the onboarding again.

The New Release screen should NOT show up.

I have three small remarks, none of them is blocking.
The implementation works as described and looks exactly like in the mockups tested with a Samsung 8.
But IMHO the button don't make sense if you visit the screen from the menu. @SamuraiKek could you please get in touch with our designers and clarify this? It also don't fit the other information screens.

Yes, this seemed weird for me too. I'll ask them.

I have three small remarks, none of them is blocking.
The implementation works as described and looks exactly like in the mockups tested with a Samsung 8.
But IMHO the button don't make sense if you visit the screen from the menu. @SamuraiKek could you please get in touch with our designers and clarify this? It also don't fit the other information screens.

Yes, this seemed weird for me too. I'll ask them.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:

But after opening it it from "Application details" menu - everything looks great.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:

But after opening it it from "Application details" menu - everything looks great.

Added the "do not merge" label as I'm waiting for some updated strings and clarification from the designers. The statistics are going to be included in release 1.11 so the text for the release notes in 1.12 is no longer relevant.

Added the "do not merge" label as I'm waiting for some updated strings and clarification from the designers. The statistics are going to be included in release 1.11 so the text for the release notes in 1.12 is no longer relevant.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:
But after opening it it from "Application details" menu - everything looks great.

That's weird. I haven't seen this so far but I'll investigate.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:
But after opening it it from "Application details" menu - everything looks great.

That's weird. I haven't seen this so far but I'll investigate.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:
But after opening it it from "Application details" menu - everything looks great.

That's weird. I haven't seen this so far but I'll investigate. There shouldn't be any difference between the one that shows up after the update and the one shown from "Application details" since it's exactly the same fragment. Only thing I could think of is the BuildConfigWrap.VERSION_CODE changing in the meantime.

Found the issue. I accidentally left a ">" symbol in the english strings file. Should be fixed now.

Tested on Samsung S8.
Found one issue:
First time (right after updating I have ">" at the end of release name:
But after opening it it from "Application details" menu - everything looks great.

That's weird. I haven't seen this so far but I'll investigate. There shouldn't be any difference between the one that shows up after the update and the one shown from "Application details" since it's exactly the same fragment. Only thing I could think of is the BuildConfigWrap.VERSION_CODE changing in the meantime.

Found the issue. I accidentally left a ">" symbol in the english strings file. Should be fixed now.

Hi @SamuraiKek & @d4rken ,
is the ENF version (#2794) still shown after this PR? On my app information screen it's gone. Could be related to #2302 , but my screen seems to be scrollable...?


Optionally create new book in current directory

For docker-compose or other starter kits, it would be nice to be able to optionally flag the softcover new command to create the book in the current directory.

Thanks for the suggestion. I don’t use Docker myself, so adding this feature isn’t a high priority, but I’d be happy to accept a pull request to this effect.