[FEA] Dask graph optimization pass for dropping columns during multi-merge workflows

[FEA] Dask graph optimization pass for dropping columns during multi-merge workflows
When working on multiple merge heavy workflows, I have often found that keeping only columns to be used in the final step and dropping columns  once they are no longer needed in the merge makes them more efficient.
It would be amazing if dask could optimize the column selection process for us.

Dask Example for this issue:
Random Data Creation Helper

import dask
import dask.array as da

from dask.distributed import Client,LocalCluster,wait
cluster = LocalCluster(n_workers=40,ip='<IP_ADDRESS>')
client = Client(cluster)

def create_random_data(n_rows=1000, n_parts = 10, n_keys=30_000_000, col_prefix = 'a'):

    chunks = n_rows//n_parts

    df = dd.concat([
        da.random.randint(0, n_keys, size=n_rows, chunks = chunks).to_dask_dataframe(columns= col_prefix + '_0'),
        da.random.randint(0, n_keys, size=n_rows, chunks = chunks).to_dask_dataframe(columns= col_prefix + '_1'),
        da.random.randint(0, n_keys, size=n_rows, chunks = chunks).to_dask_dataframe(columns= col_prefix + '_2'),
        da.random.randint(0, n_keys, size=n_rows, chunks = chunks).to_dask_dataframe(columns= col_prefix + '_3'),
        da.random.randint(0, n_keys, size=n_rows, chunks = chunks).to_dask_dataframe(columns= col_prefix + '_val_col')

    ], axis=1).persist()

    _ = wait(df)
    del _

    return df

import dask.dataframe as dd
n_rows = 50_000_000
n_parts = 160

df_1 = create_random_data(n_rows = n_rows, n_parts = n_parts, col_prefix = 'a')
df_2 = create_random_data(n_rows = n_rows, n_parts = n_parts, col_prefix = 'b')
df_3 = create_random_data(n_rows = n_rows, n_parts = n_parts, col_prefix = 'c')
df_4 = create_random_data(n_rows = n_rows, n_parts = n_parts, col_prefix = 'd')
df_5 = create_random_data(n_rows = n_rows, n_parts = n_parts, col_prefix = 'e')

Without Filtering in merges
Time: 1min 32s
Peak Memory:  ~150 GB+
merged_df = df_1.merge(df_2, left_on = ['a_0'], right_on = ['b_0'])
merged_df = merged_df.merge(df_3, left_on = ['b_1'], right_on = ['c_1'])
merged_df = merged_df.merge(df_4, left_on = ['c_2'], right_on = ['d_2'])
merged_df = merged_df.merge(df_5, left_on = ['d_3'], right_on = ['e_3'])
final_cols = [prefix + '_val_col' for prefix in ['a','b','c','d']]
merged_df = merged_df[final_cols]

%time len(merged_df)

CPU times: user 1min 16s, sys: 12.4 s, total: 1min 28s
Wall time: 1min 32s
385780301

With Filtering in merges
Time:  56.7 s
Peak Memory:  ~80 Gb ish
merged_df = df_1.merge(df_2, left_on = ['a_0'], right_on = ['b_0'])
merged_df = merged_df[['a_val_col','b_val_col','b_1']]

merged_df = merged_df.merge(df_3, left_on = ['b_1'], right_on = ['c_1'])
merged_df = merged_df[['a_val_col','b_val_col','c_val_col','c_2']]

merged_df = merged_df.merge(df_4, left_on = ['c_2'], right_on = ['d_2'])
merged_df = merged_df[['a_val_col','b_val_col','c_val_col','d_val_col','d_3']]

merged_df = merged_df.merge(df_5, left_on = ['d_3'], right_on = ['e_3'])
final_cols = [prefix + '_val_col' for prefix in ['a','b','c','d']]
merged_df = merged_df[final_cols]

%time len(merged_df)

CPU times: user 49.5 s, sys: 6.1 s, total: 55.6 s
Wall time: 56.7 s
385780301

Gist: https://gist.github.com/VibhuJawa/bcabfec1506b9b30df7d5d1dd3c1eecd
Really sorry for the delay in getting around to this. This slipped through cracks . Hope above example helps.
CC: @rjzamora / @quasiben

I'm interested in this!
From a purely 'information' point of view, it looks like the scheduler has all the knowledge it needs to do this?
I can't see a reason why the scheduler wouldn't be able to know, from the requested columns in the final compute/persist, what columns it needs from the data frames in the underlying graph to run the compute.
Am I overlooking something here?
I'd be interested in having a crack at this, but am currently expecting it to defeat me as I'm probably only at the stage where I'd be comfortable picking up "good second issues".
I'm also uncertain whether this would be a change in dask.dataframe or in the scheduler/optimizer.

cc @madsbk

Are there workflows that don't necessarily have multiple merges where this would be useful?
I think in theory there could be and the more general thing you would want to optimize for is to minimize the number of columns present at all stages of task graph execution. And you could do that by dropping columns at the latest point in the graph where they are used. But I don't know if there are cases in practice where this more general optimization would be useful.


fix(core): add a prefixMode option to correct prefixes on nested embeddables

fixes #6112
I'm not totally convinced by the documentation I propose ...

btw if you would be up for another PR, there is also #5361 which might be quite similar to what you did here. but lets first finish this one and not mix those two problems

next time please allow others to change your PR, I cant commit the suggestion myself

Oh sorry about that, but it seems that I can not allow it from a fork living under an organisation (cf. discussion).
I'll use a personal fork for future PRs.


Weapon handlers

[x] Flamethrower

[ ] Tank heating

[x] Freeze

[ ] Tank freezing

[x] Isida
[x] Railgun

[x] Fire through multiple tanks (damage weakening)

[x] Ricochet

[x] Self-damage

[x] Shaft

[x] Arcade mode
[x] Sniping mode

[x] Smoky

[ ] Critical shots

[x] Thunder

[ ] Splash damage
[x] Self-damage

[x] Twins

nice work, also note that ricochet misses self damage

Пора добавить, аптеки - сплеш от грома)


How to custom my pageloading option

I have an API that provide data like this above :
{
    "count": 1023
    "next": "https://api.example.org/accounts/?page=5",
    "previous": "https://api.example.org/accounts/?page=3",
    "results": [
       …
    ]
}

this API is paginated , so I set     pageLoading to true, expecting jsgrid could automatically load the other pages
but what jsgird needed is that data should be in data instead of results
https://github.com/tabalinas/jsgrid/blob/master/README.md#grid-controller
I ve look through the docs but found nothing about custom those stuff.
So I opened this issue.

If I understand your question, you need
loadData: function(filter) {
    return $.get('your.api', filter).then(function(response) {

        var result = {
            data: response.results || [],
            itemsCount: response.count || 0
        }

        return result;

    })
}

that works, thanks
2015年11月5日 下午8:37，"Andrey Kalashnikov"<EMAIL_ADDRESS>
If I understand your question, you need
loadData: function(filter) {
return $.get('your.api', filter).then(function(response) {
    var result = {
        data: response.results || [],
        itemsCount: response.count || 0
    }

    return result;

})

}
—
Reply to this email directly or view it on GitHub
https://github.com/tabalinas/jsgrid/issues/134#issuecomment-154047060.


Add glibc (libc6) as dependency to debian package

The non-musl .deb packages depend on glibc (libc6 package). Can we add that as a dependency?
Adding Depends: libc6 after this line would work, but that would also be included in the musl .deb packages. I am what is the best way.
Also, we may need an appropriate dependency for musl based .deb packages.

Only including the dependency is not sufficient.
Including the required minimum versions is also required.
The standard debian packaging tool dpkg-shlibdeps should be used to generate the control file dependencies based on the included binaries. https://manpages.debian.org/testing/dpkg-dev/dpkg-shlibdeps.1.en.html

Sure, let's do that.


Remove Hacktoberfest from TOC

Removing article from the TOC but not archiving all together in case we want to use it next year.

@jehchow #sign-off


Fix go formatting issue, fix typo

This PR fixes a typo I spotted in the project.
It also resolves go formatting issues.

This PR should be ready for merging now.


Add semeval 2020 task 11

Adding in propaganda detection task (task 11) from Sem Eval 2020

@SBrandeis : Thanks for the feedback! Just updated to use context manager for the opens and removed the placeholder text from the README!

Great, thanks @ZacharySBrown !
Failing tests seem to be unrelated to your changes, merging the current master branch into yours should fix them.


[FZ Editor] gray out canvas layouts that don't match the current screen resolution

In the new UI https://github.com/microsoft/PowerToys/pull/8148, gray out the canvas layouts that have been created for screens with a different resolution compared to the select monitor.
We need to support multiple layouts per DeviceID, updating the active zoneset schema with the scaled screen resolution.

We should add a explanation tooltip / message as well.

Can we show the views of the layout with their real proportion and can we show the resolution for each layout? Mayba as a tooltip like this "Layout for disply resolution 16:9"?

@htcfreek

Can we show the views of the layout with their real proportion

I would say no, because it would horrible if you have two monitors with significant resolution difference.

To give a visual feedback to the users, we should add the work area size below canvas layouts (consider increasing the thumbnail preview to make room for the text)

To give a visual feedback to the users, we should add the work area size below canvas layouts (consider increasing the thumbnail preview to make room for the text)

Will this be shown at all times? Or only when the monitor setting is different from the canvas workarea?
If so, I'd really try to avoid adding the resolution as is to prevent any clutter. Maybe an ( i ) icon in the card with a tooltip showing the work area and an additional explanation / link to the FZ docs? This would allow for describing what the wprkarea actually means.

@niels9001
tooltip is not really what we need here because we want this information clearly available when it's needed.
For the editor, functionality comes first, if a user has multiple monitors with different resolutions or layouts for the same monitor but with different DPIs or different toolbar positions, this information must be visible.
Let's not overcomplicate things, and for now let's show this information all the time for canvas layouts, we can always improve it later on not showing it when it's not needed if users will ask for it.

closing due to https://github.com/microsoft/PowerToys/issues/14261 will take priority as fix


Visual Studio 2015 Kits doesn't work if installed via newer Visual Studio Build Tools.

Brief Issue Summary
I've installed VS2015 Build Tools via the latest version of Visual Studio Installer.
It is known that VS2015 Build Tools that is installed with newer VS installer will not have its shortcuts working correctly (including it's vcvarsall.bat).
The correct way to load up VS2015 Build Tools into a command prompt is to load using VS2017/9's vcvarsall.bat with argument vcvars_ver.
Expected:

Load VS2015 kit
Reconfigure the project
The project should be successfully configured.

Apparent Behavior:

Load VS2015 kit
Reconfigure the project
CMake Tools errors.

CMake Tools Log
[main] Configuring folder: test_cmake
[proc] Executing command: "C:\Program Files\CMake\bin\cmake.EXE" --no-warn-unused-cli -DCMAKE_EXPORT_COMPILE_COMMANDS:BOOL=TRUE -Hc:/Users/Sarun/dev/test_cmake -Bc:/Users/Sarun/dev/test_cmake/build -G "Visual Studio 14 2015" -T host=x64 -A x64
[cmake] Not searching for unused variables given on the command line.
[cmake] -- Selecting Windows SDK version 10.0.14393.0 to target Windows 10.0.19041.
[cmake] CMake Error at CMakeLists.txt:3 (project):
[cmake]   Failed to run MSBuild command:
[cmake]
[cmake]     MSBuild.exe
[cmake]
[cmake]   to get the value of VCTargetsPath:
[cmake]
[cmake]     Microsoft (R) Build Engine version 4.8.4084.0
[cmake]     [Microsoft .NET Framework, version 4.0.30319.42000]
[cmake]     Copyright (C) Microsoft Corporation. All rights reserved.
[cmake]
[cmake]     Build started 22/07/2020 18:19:59.
[cmake]     Project "C:\Users\Sarun\dev\test_cmake\build\CMakeFiles\3.18.0\VCTargetsPath.vcxproj" on node 1 (default targets).
[cmake]     C:\Users\Sarun\dev\test_cmake\build\CMakeFiles\3.18.0\VCTargetsPath.vcxproj(15,2): error MSB4019: The imported project "C:\Microsoft.Cpp.Default.props" was not found. Confirm that the path in the <Import> declaration is correct, and that the file exists on disk.
[cmake]     Done Building Project "C:\Users\Sarun\dev\test_cmake\build\CMakeFiles\3.18.0\VCTargetsPath.vcxproj" (default targets) -- FAILED.
[cmake]
[cmake]     Build FAILED.
[cmake]
[cmake]     "C:\Users\Sarun\dev\test_cmake\build\CMakeFiles\3.18.0\VCTargetsPath.vcxproj" (default target) (1) ->
[cmake] -- Configuring incomplete, errors occurred!
[cmake] See also "C:/Users/Sarun/dev/test_cmake/build/CMakeFiles/CMakeOutput.log".
[cmake]       C:\Users\Sarun\dev\test_cmake\build\CMakeFiles\3.18.0\VCTargetsPath.vcxproj(15,2): error MSB4019: The imported project "C:\Microsoft.Cpp.Default.props" was not found. Confirm that the path in the <Import> declaration is correct, and that the file exists on disk.
[cmake]
[cmake]         0 Warning(s)
[cmake]         1 Error(s)
[cmake]
[cmake]     Time Elapsed 00:00:00.24
[cmake]
[cmake]
[cmake]   Exit code: 1
[cmake]
[cmake]
[cmake]

The cmake log is identical to what happens when I use VS2015's vcvarsall.bat.
Developer Tools Log
I only provided the relevant bit here.
varsForVSInstallation path:'C:\Program Files (x86)\Microsoft Visual Studio 14.0\' version:14.0 host arch:x64 - target arch:x64
[debug] [kit] OK running C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\vcvarsall.bat amd64, env vars: [["CL",""],["_CL_",""],["INCLUDE","C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\INCLUDE;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\ATLMFC\\INCLUDE;C:\\Program Files (x86)\\Windows Kits\\10\\include\\10.0.14393.0\\ucrt;C:\\Program Files (x86)\\Windows Kits\\10\\include\\10.0.14393.0\\shared;C:\\Program Files (x86)\\Windows Kits\\10\\include\\10.0.14393.0\\um;C:\\Program Files (x86)\\Windows Kits\\10\\include\\10.0.14393.0\\winrt;"],["LIBPATH","C:\\WINDOWS\\Microsoft.NET\\Framework64\\v4.0.30319;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\LIB\\amd64;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\ATLMFC\\LIB\\amd64;C:\\Program Files (x86)\\Windows Kits\\10\\UnionMetadata;C:\\Program Files (x86)\\Windows Kits\\10\\References;\\Microsoft.VCLibs\\14.0\\References\\CommonConfiguration\\neutral;"],["LINK",""],["_LINK_",""],["LIB","C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\LIB\\amd64;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\ATLMFC\\LIB\\amd64;C:\\Program Files (x86)\\Windows Kits\\10\\lib\\10.0.14393.0\\ucrt\\x64;C:\\Program Files (x86)\\Windows Kits\\10\\lib\\10.0.14393.0\\um\\x64;"],["PATH","C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\amd64;C:\\WINDOWS\\Microsoft.NET\\Framework64\\v4.0.30319;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\Common7\\IDE;C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\Common7\\Tools;C:\\Program Files (x86)\\HTML Help Workshop;C:\\Program Files (x86)\\Windows Kits\\10\\bin\\x64;C:\\Program Files (x86)\\Windows Kits\\10\\bin\\x86;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\;C:\\Program Files (x86)\\gnupg\\bin;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\xampp\\php;C:\\ProgramData\\ComposerSetup\\bin;C:\\Program Files\\nodejs\\;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files (x86)\\Yarn\\bin\\;D:\\AndroidSDK\\platform-tools;D:\\Program Files\\Android\\Android Studio\\jre\\bin;C:\\Program Files\\Git\\cmd;C:\\Users\\Sarun\\AppData\\Local\\Microsoft\\WindowsApps;;C:\\Users\\Sarun\\AppData\\Local\\Programs\\Microsoft VS Code\\bin;C:\\Program Files\\LLVM\\bin;C:\\Program Files\\CMake\\bin"],["TMP","C:\\Users\\Sarun\\AppData\\Local\\Temp"],["FRAMEWORKDIR","C:\\WINDOWS\\Microsoft.NET\\Framework64"],["FRAMEWORKDIR64","C:\\WINDOWS\\Microsoft.NET\\Framework64"],["FRAMEWORKVERSION","v4.0.30319"],["FRAMEWORKVERSION64","v4.0.30319"],["UCRTCONTEXTROOT",""],["UCRTVERSION","10.0.14393.0"],["UNIVERSALCRTSDKDIR","C:\\Program Files (x86)\\Windows Kits\\10\\"],["VCINSTALLDIR","C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\"],["VCTARGETSPATH",""],["WINDOWSLIBPATH","C:\\Program Files (x86)\\Windows Kits\\10\\UnionMetadata;C:\\Program Files (x86)\\Windows Kits\\10\\References"],["WINDOWSSDKDIR","C:\\Program Files (x86)\\Windows Kits\\10\\"],["WINDOWSSDKLIBVERSION","10.0.14393.0\\"],["WINDOWSSDKVERSION","10.0.14393.0\\"],["VISUALSTUDIOVERSION","14.0"]]

This shows that the CMake Tools is using the vcvarsall.bat that came with VS2015 Build Tools (C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\vcvarsall.bat) instead of the modern vcvarsall.bat (In my case, it is at C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\VC\Auxiliary\Build\vcvarsall.bat).
Platform and Versions

Operating System: Windows 10 version 2004
CMake Version: 3.18.0
VSCode Version: 1.47.2
CMake Tools Extension Version: 1.4.1
Compiler/Toolchain: Visual C++ 2015

Other Notes/Information
I've narrowed down the code that should be change. I think.
https://github.com/microsoft/vscode-cmake-tools/blob/d53c266c9b0bb43a2b1ca3d68c04de49fe5fc717/src/kit.ts#L672-L676

any updates on this?

I just found a workaround for this, as I am facing the same problem:
Create a batch file that sets up your build environment. I called it env.bat and for me it looks like this:
call "C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\VC\Auxiliary\Build\vcvarsall.bat" x86_amd64 -vcvars_ver=14.16

Then setup a custom CMake-Kit by editing your %localappdata%\CMakeTools\cmake-tools-kits.json (open using Command Palette: > CMake: Edit User-Local Cmake Kits) and add your own kit. You can copy an existing Kit, but I had to remove some Visual Studio specifics ("visualStudio" and "visualStudioArchitecture") to get it working without errors. As I am trying to use ninja for building, I changed the generator to Ninja. If you want to stay with MSBuild, you probably should keep the generator from the kit you copied. The "keep": true in there makes the new entry persist in case you scan for kits again. So here is mine:
[
  {
    "name": "Visual Studio Professional 2017 Release - x86_amd64",
    "environmentSetupScript": "path\\to\\your\\env.bat",
    "keep": true,
    "preferredGenerator": {
      "name": "Ninja"
    }
  }
]

Then save the file. I immediately got some errors about json parsing failing:
[kit] Failed to parse cmake-tools-kits.json:
	SyntaxError: Unexpected EOF at line 1 column 2 of the JSON5 data. Still to read: ""
	at error (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:20167:25)
	at word (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:20504:13)
	at value (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:20604:56)
	at Object.parse (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:20619:18)
	at Object.readKitsFile (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:9318:26)
	at async Function.readUserKits (c:\Users\<snip>\.vscode-server\extensions\ms-vscode.cmake-tools-1.6.0\dist\main.js:15430:27)

I ignored those and reloaded/restarted VSCode instead. Afterwards there weren't any json parsing errors any more.
Finally, select the newly added kit (Command Palette: > CMake: Select a Kit). Now I have the correct environment when building.
I hope it helps.

Been having the same issue and output like you with msvc2015 installed from a VS 2017 setup on Windows 10, with other IDEs as well.
What I've found then is that Windows 10 comes with some sort of .Net Framework which also has a MSBuild by itself which is found in path before the one from MSVC, and the only working solution was to prepend to PATH the correct MSBuild, e.g. in my case %programfiles(x86)%/Microsoft Visual Studio/2017/Proffesional/MSBuild/15.0/Bin

@sarunint @pborsutzki @danimihalca Is this issue still remaining?

@sarunint @pborsutzki @danimihalca Is this issue still remaining?

I'm not using that environment anymore, therefore I cannot reproduce it, nor is it relevant for me as a consumer.


Remove unused 'skip' input parameter

Describe the bug
PIS input parameters offers the skip flag for working through errors by just reporting them, but the flag has no effect in the pipeline behavior.
Action
This input parameter needs to be removed from PIS, as it's not being used currently.

Done!
PR


Foollowing import "from janome.tokenizer import Tokenizer" causes imports of other libraries (e.g. boto3 or aiohttp) in python 3 to fail

Simply try the following:
from janome.tokenizer import Tokenizer
s3_client = boto3.client('s3')

This will show the following error
(env3) quaizars-mbp(~/work/rupert)>python algo/test2.py
Traceback (most recent call last):
  File "algo/test2.py", line 3, in <module>
    s3_client = boto3.client('s3')
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/__init__.py", line 83, in client
    return _get_default_session().client(*args, **kwargs)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/session.py", line 263, in client
    aws_session_token=aws_session_token, config=config)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/botocore/session.py", line 836, in create_client
    client_config=config, api_version=api_version)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/botocore/client.py", line 65, in create_client
    cls = self._create_client_class(service_name, service_model)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/botocore/client.py", line 89, in _create_client_class
    base_classes=bases)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/botocore/hooks.py", line 227, in emit
    return self._emit(event_name, kwargs)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/botocore/hooks.py", line 210, in _emit
    response = handler(**kwargs)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/utils.py", line 61, in _handler
    module = import_module(module)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/utils.py", line 52, in import_module
    __import__(name)
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/s3/inject.py", line 15, in <module>
    from boto3.s3.transfer import create_transfer_manager
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/boto3/s3/transfer.py", line 127, in <module>
    from s3transfer.exceptions import RetriesExceededError as \
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/s3transfer/__init__.py", line 134, in <module>
    import concurrent.futures
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/concurrent/futures/__init__.py", line 8, in <module>
    from concurrent.futures._base import (FIRST_COMPLETED,
  File "/Users/quaizar/work/env3/lib/python3.6/site-packages/concurrent/futures/_base.py", line 381
    raise exception_type, self._exception, self._traceback
                        ^
SyntaxError: invalid syntax

The problem is caused by the line "sys.path.insert(0, parent_dir)" in sysadic/init.py
import os, sys
base_dir = os.path.dirname(os.path.abspath(__file__))
parent_dir = os.path.dirname(base_dir)
sys.path.insert(0, parent_dir)
...

If you comment this line out, things work fine.

I tried to reproduce the error but it did not occurred.
(venv) $ python -V
Python 3.6.6

(venv) $ pip freeze
boto3==1.9.107
botocore==1.12.107
docutils==0.14
Janome==0.3.7
jmespath==0.9.4
python-dateutil==2.8.0
s3transfer==0.2.0
six==1.12.0
urllib3==1.24.1

(venv) $ python
Python 3.6.6 (default, Jul 19 2018, 16:29:00)
[GCC 7.3.1 20180303 (Red Hat 7.3.1-5)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import boto3
>>> from janome.tokenizer import Tokenizer
>>> s3_client = boto3.client('s3')
>>>

Can you please provide more specific information for reproducing?

I have the same issue.
After this in my code:
from janome.tokenizer import Tokenizer
The sys.path is changed so that Janome package path is first in the sys.path list and causes other imports from my code to fail.
Especially, I have a version.py in my code and when I do import in my code like this:
My code module: (version.py)
My project server version
_ver = 'v1.0'
and in another part of my code: (main.py)
from version import _ver
This raises an import Error.

Thanks for reporting with reproducible example! Actually the sys.path change isn't needed for latest Janome at all. I've uploaded v0.3.10 that only includes the patch #69 to PyPI.
This should fix the problem, can you check the latest version (0.3.10)?


Active index page for REST server

I also cleaned up the REST server considerably so it now handles errors a lot better.
Here's the page after it got or set data successfully:

Here's the error page:

@estiens

Nice! +1
On Wed, Aug 22, 2018 at 10:51 AM Tom Swirly<EMAIL_ADDRESS>wrote:

I also cleaned up the REST server considerably so it now handles errors a
lot better.
Here's the page after it got or set data successfully:
[image: screen shot 2018-08-22 at 16 45 31]
https://user-images.githubusercontent.com/253362/44471134-921d5300-a62b-11e8-8017-d02d1663b8d4.png
Here's the error page:
[image: screen shot 2018-08-22 at 16 45 56]
https://user-images.githubusercontent.com/253362/44471156-9ba6bb00-a62b-11e8-9d3d-93e8d4e0a2ac.png
@estiens https://github.com/estiens
You can view, comment on, or merge this pull request online at:
https://github.com/ManiacalLabs/BiblioPixel/pull/935
Commit Summary

Clean up the REST projects
Better reporting of exceptions in all_test
Add jquery.js
Move rest.py into its own subdirectory
Active index page for REST server

File Changes

D bibliopixel/control/rest.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-0
(229)
A bibliopixel/control/rest/README.md
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-1
(86)
A bibliopixel/control/rest/init.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-2
(1)
A bibliopixel/control/rest/rest.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-3
(145)
A bibliopixel/control/rest/server.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-4
(34)
M projects/25-rest.yml
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-5
(21)
M projects/26-simple-rest.yml
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-6
(23)
M test/bibliopixel/all_test.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-7
(45)
M test/bibliopixel/import_all.py
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-8
(8)
A ui/rest/index.html
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-9
(46)
A ui/rest/static/README.txt
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-10
(1)
A ui/rest/static/index.js
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-11
(53)
A ui/rest/static/jquery.js
https://github.com/ManiacalLabs/BiblioPixel/pull/935/files#diff-12
(2)

Patch Links:

https://github.com/ManiacalLabs/BiblioPixel/pull/935.patch
https://github.com/ManiacalLabs/BiblioPixel/pull/935.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ManiacalLabs/BiblioPixel/pull/935, or mute the thread
https://github.com/notifications/unsubscribe-auth/AA6a6s55IJykOkgWvTUoLTVZl9YLeOwoks5uTXAHgaJpZM4WH0b8
.

Ah, I just pushed a last change at the end after you approved.  :-D
A new class called rest.OpenPage that is the Rest control that opens the main page.
Why?  So you can do this:
bp my-project.yml + '{controls: rest.OpenPage}'

and it will immediately pop up the rest page to play with...

+1
On Wed, Aug 22, 2018 at 11:58 AM Tom Swirly<EMAIL_ADDRESS>wrote:

Ah, I just pushed a last change at the end after you approved. :-D
A new class called rest.OpenPage that is the Rest control that opens the
main page.
Why? So you can do this:
bp my-project.yml + '{controls: rest.OpenPage}'
and it will immediately pop up the rest page to play with...
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ManiacalLabs/BiblioPixel/pull/935#issuecomment-415084242,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA6a6rW1991gbomjvyNdajZQUtJBhbFtks5uTX-tgaJpZM4WH0b8
.


datacloneerror on postMessage in worker.

Zone modifies Promise by adding extra properties to object, so it cannot be serialized. Is there any workaround for this case?

@snovos , could you provide more information? or a reproduce repo?

@JiaLiPassion ,Thi is  sample code from PDF.js by Mozilla.
Promise.resolve().then(function () {
          return action[0].call(action[1], data.data);
        }).then((result) => {
          comObj.postMessage({
            sourceName,
            targetName,
            isReply: true,
            callbackId: data.callbackId,
            data: result,
          });
        }, (reason) => {
          comObj.postMessage({
            sourceName,
            targetName,
            isReply: true,
            callbackId: data.callbackId,
            error: makeReasonSerializable(reason),
          });
        });

So in reason object I can see some  Function type properties, added by zone.
When postMessage is called, reason cannot be serialized  since Functions and Errors cannot be cloned and throws DATA_CLONE_ERR. Any ideas?

@snovos , the reason object is a promise or an error? could you post a reproduce repo or plunker? thanks.

@JiaLiPassion  https://github.com/snovos/pdf-zone.
Please run "npm start" and observe that if you pass wong url to  component, it throws an error I described above. Please  let me know if you were able to reproduce

@snovos, thanks for the reproduce repo, I have made a PR to fix this one.

@JiaLiPassion  Greath! Thanks

@snovos , I can create a branch and can update your zone.js in package.json to point to my branch.

@JiaLiPassion  That would be great. I appreciate it, thanks!

@snovos, you can use this branch ,https://github.com/JiaLiPassion/zone.js/tree/jsondist

@JiaLiPassion thanks a lot. That works.


The project requires a platform SDK(UAP, Version=10.10586.0) that is not installed.  Please visit..

I am using VS2015 Update 3 Community.  I installed Template 10. When I start a new Project-->Universal-->Template 10 - with any of these after selecting the Target and minimum platform versions - I get the platform SDK missing error.  Please advise.

You need the 10586 version of the SDK. VS2015 comes with 14393, and the
older 10586 SDK is optional.
You should be able to install it from Programs and Features.
On Mon, 3 Apr 2017, 10:26 PM RandyB341<EMAIL_ADDRESS>wrote:

I am using VS2015 Update 3 Community. I installed Template 10. When I
start a new Project-->Universal-->Template 10 - with any of these after
selecting the Target and minimum platform versions - I get the platform SDK
missing error. Please advise.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/Windows-XAML/Template10/issues/1431, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AM3pI0xagBFzLOi-UQO7XkNptiCeuqd0ks5rsMk0gaJpZM4MxWkA
.

--
Thanks,
Callum

Thanks, I will try that!
On Mon, Apr 3, 2017 at 6:52 AM, Callum Moffat<EMAIL_ADDRESS>wrote:

You need the 10586 version of the SDK. VS2015 comes with 14393, and the
older 10586 SDK is optional.
You should be able to install it from Programs and Features.
On Mon, 3 Apr 2017, 10:26 PM RandyB341<EMAIL_ADDRESS>wrote:

I am using VS2015 Update 3 Community. I installed Template 10. When I
start a new Project-->Universal-->Template 10 - with any of these after
selecting the Target and minimum platform versions - I get the platform
SDK
missing error. Please advise.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/Windows-XAML/Template10/issues/1431, or mute the
thread
<https://github.com/notifications/unsubscribe-auth/AM3pI0xagBFzLOi-
UQO7XkNptiCeuqd0ks5rsMk0gaJpZM4MxWkA>
.

--
Thanks,
Callum
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Windows-XAML/Template10/issues/1431#issuecomment-291110189,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AZn_tsZ5pL6EFGxk6kf-IiKFFLZochhuks5rsM-LgaJpZM4MxWkA
.


Improve error messages when creating an invalid PFFile.

Currently, if you attempt to create a PFFile with a nil NSData parameter, you get a strange 'file not found' error when attempting to save it to Parse.
Let's make this either

Throw an exception
Make the PFFile constructor return nil, when invalid data is passed in.

Somewhat relates to #6.

Sounds great! Let's do it!
We have this method:
+ (instancetype)fileWithName:(PF_NULLABLE NSString *)name
                        data:(NSData *)data
                 contentType:(PF_NULLABLE NSString *)contentType
                       error:(NSError **)error;

Which returns nil and if there was an error - it will be populated.
What do you think if we take this approach:

Check for nil on NSData (it's ok if it's empty probably, not ok if it's nil)
Add more methods that accept pointer-to-a-pointer-to-an-error (nice name :grin:)
Mark methods without an error: parameter as unavailable in Swift, so whoever uses Swift gets throws :)

This is probably an example of the method signature that we are aiming for in Swift:
public convenience init(name: String?, data: NSData, contentType: String?) throws
Which is a result of this in ObjC:
+ (PF_NULLABLE instancetype)fileWithName:(PF_NULLABLE NSString *)name
                                    data:(NSData *)data
                             contentType:(PF_NULLABLE NSString *)contentType PF_SWIFT_UNAVAILABLE;

+ (PF_NULLABLE instancetype)fileWithName:(PF_NULLABLE NSString *)name
                                    data:(NSData *)data
                             contentType:(PF_NULLABLE NSString *)contentType
                                   error:(NSError **)error;


Load C libraries in a nicer way

No more cascading try/catch :slightly_smiling_face:
One unrelated thing: When I tried to run the tests locally I got this error:
Error opening terminal: rxvt-unicode-256color.

It was easily fixable by just setting ENV["TERM"] = "xterm". But maybe that's something that should be addressed in the test code.

This is awesome! Thanks @christopher-dG.

With respect to the ENV. I really never saw something like. Can you please tell me what is your setup (terminal, OS, etc.)?

I'm on Arch Linux, my terminal is rxvt-unicode which sets TERM to rxvt-unicode-256color by default. I think it'll be a fairly rare issue to come up.

I will try to reproduce in a VM.

This also occurs with xterm and st, and probably many other terminals as well. I think we'd need to lookup the terminal in terminfo to figure out how to launch a new terminal session correctly.

@jpsamaroo is it related to NCurses version in NCurses_jll?

No, I mean that `ENV["TERM"] doesn't always equal the terminal executable that you want to launch.

But this isn't this outside the scope of Julia? AFAIK, this must be set by the terminal right?


Monospace Font for code

Current source code uses a regular font as it was done in Flutter Quill. Which is not the way code editors handle this situation.

Join on discord to get advice and help or follow us on YouTube Visual Coding to learn more about the architecture of Visual Editor and other Flutter apps.

You are supposed to feed your required style for each different tags when creating the editor, there you can specify which font family to use, the source code of quill in general is style agnostic, meaning all styles of all the different types of fragment are supposed to be SET BY the USER.
customStyles: DefaultStyles(
...
code: DefaultTextBlockStyle(
const TextStyle(
fontFamily: 'RobotoCondensed', // fill in your favorite mono font
color: Colors.black87,
fontSize: 15,
height: 1.4,
),
const Tuple2(0, 10),
const Tuple2(0, 5),
const BoxDecoration(
color: Color(0xFFFCFCFC),
borderRadius: BorderRadius.all(Radius.circular(5)),
),
),
)

Yes indeed, you can override styles, but that does not mean you can't provide a decent default value. Right? Code is never displayed in fonts that are not mono space for practical reasons. A sensible default does not harm. Quill Also decides a default font size. Obviously, it has to do so. Then if the font size has a default, why not a default for the code snippets? Any decent .md implementation will do the same for code snippets. Why not Quill?

Also included in this commit:

Added a distinct icon for code block in the toolbar because it was using the same icon as inline code button.


not work in server

Hello @mgufrone , I have a problem uploading my project to the server.
I comment to you.
It worked perfectly on my local Windows machine using this code:
<?php
include 'vendor/autoload.php';
use Gufy\PdfToHtml\Config;
Config::set('pdftohtml.bin', __DIR__.'/Poppler/bin/pdftohtml.exe');
Config::set('pdfinfo.bin', __DIR__.'/Poppler/bin/pdfinfo.exe');
$p = 'sample.pdf';
$pdf = new Gufy\PdfToHtml\Pdf($p);
$pdf->html();
?>
But unfortunately the PHP code will run on Linux server where exe files could not run on. So I found there is a usage note for OS/X and Debian/Ubuntu to use:
Config::set('pdftohtml.bin', __DIR__.'/usr/local/bin/pdftohtml');
Config::set('pdfinfo.bin', __DIR__.'/usr/local/bin/pdfinfo');
Instead of:
Config::set('pdftohtml.bin', __DIR__.'/Poppler/bin/pdftohtml.exe');
Config::set('pdfinfo.bin', __DIR__.'/Poppler/bin/pdfinfo.exe');

How can I identify /usr/local/bin/ on a Linux server ?
How can I install Poppler-Utils for Linux ?
Is it possible to do all this on a shared hosting ?

I appreciate your help

You can't install this package unless you have full access to your server. If you are in shared hosting and your provider is a good partner to you, try to ask them to install the package of poppler-utils on th server.
To determine where is the exact location of pdfinfo and pdfhtml on linux-based server, you can  do this
which pdfinfo
which pdfhtml

You will get the location of each binaries if you have already installed poppler-utils properly on your server.

thanks for answering, there will be a way to install it myself, the server provider almost not answer me and I need urgent

I tell you that I found the method to execute, simply use the following line
shell_exec("/usr/bin/pdftohtml mypdf.pdf $output_folder/mypdf 2>&1")
I did not have to upload any file, only with that line it worked perfect, thanks for your help.


docs(main-doc): add missing LoaderData export

Summary
docs(main-doc): 导出 LoaderData 类型 检查代码高亮
Related Issue
N/A
Checklist

[x] I have added changeset via pnpm run change.
[x] I have updated the documentation.
[x] I have added tests to cover my changes.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Lint(Ubuntu): @modern-js/main-doc not allow bump major version in sharp-crews-pump.md file

Yeah you should choose the "patch" option when running change command


Revisit SignatureInput to allow custom signers to sign messages

SignatureInput currently requires private key. However there would be cases where private key is not available (e.g. key securing services, TPM, hardware-wallets).
A better model could be allowing a custom Signer to be injected, with perhaps a default implementation still expecting a private key as input.

@thehenrytsai Would it be possible to take this approach?
Rather than injecting a custom Signer that the DWN SDK would call instead of the default implementation...

IF a private key isn't passed in authorizationSignatureInput  to a given .create() method
THEN an unsigned DWeb messages is returned

The developer would then have to handle signing with their "keystore" (TPM, secure enclave, hardware wallet, etc.) before passing the message to processMessage().
This would allow for UI interactions that might be asynchronous and require human intervention, such as signing with a hardware wallet.

Hey @frankhinek, definitely sounds reasonable in principle, though I would point out that it does mean that messages created by .create() methods could be "half-baked" and allows the situation where some instance methods/properties can't be used, (ie. will blow up if called) due to absence of the authorization property.

Maybe there could be a parameter for the .create() methods with the default value being how it is now (private key was present and signatureMaterial has already been created), and then something like 'wallet' to read the private key/alg and create the signatureMaterial value within the method, plus a third option 'signer' where the signatureMaterial value will be passed in (as in it has been generated externally)

This is now done.


Edit the svg to change the values of the highlighted element

Good morning, how could you edit the lighting of the svg strokes or when you do, do not re-edit and return to its original values if I scroll or remove the scroll. I am calculating some width and height values once the element has been illuminated to edit it, then I create again the string of the svg path’s d attribute to change it with jquery but then if the scroll changes or if the illuminated element is a select, if I select one of your options it also returns to its original values.

@Dazava What drastic changes do you want to apply to the SVG that this is necessary?
You have control over the basic properties such as the color, and border-radius. You also can use CSS to select the SVG and overwrite any properties you want to overwrite that are supported by CSS.


zeroconf ( rendez-vous  in Apple ) address not recognzied

Describe the bug
When creating a new connection, zeroconf name is not recognized even the host supports it.
To Reproduce
Steps to reproduce the behavior:

Click "Add connection"
Input zeroconf name ( for example. myhost.local )
Click "test connection"
See error

Expected behavior
Zeroconf names should be recongnized if the host has support.
Screenshots
Desktop (please complete the following information):

OS: Ubuntu
Version 21.04

Hello @since19861019 ,
this issue is kinda strange because i have some machines in my network with .local addresses and i can reach them with Antares.
It should work with Zeroconf also because address resolution is something done on a different level than database drivers.
I haven't found nothing about Zeroconf or mDNS related to used MySQL drivers but i'll try to reproduce this issue next days.
Can you say me if you reach the host with other database clients, and the error you got from Antares?
Thanks

I re-checked the access to my zeroconf database.
My local db is ds116.local ( Synology NAS +  MariaDB ).
ping ds116.local => works
firefox ds116.local => works
mysql -h ds116.local -P 3307 -u {user} -p => works
Antares =>  fails
If I change the Antares setting from Zeroconf to IP ( which I got from ping ), it works.

Is your Antares installation from Ubuntu Snap Store?

Is your Antares installation from Ubuntu Snap Store?

Yes.

The problem is related to snap distributions that lack mDNS address support by default. The support was implemented just some days ago on snap core20 and will be available soon, i think.
Until then i found and tested a workaround to support Zeroconf/mDNS thah you'll find in next release.
Thanks again for this report, I would never have noticed this problem on my own.


when the desciption exist exponential,In Vscode it show integer and wrong

I am try a algorithms of leetcode in vscode.
reverse-integer
id=7 lang=javascript
the description in VsCode show:
[−231,  231 − 1]

the desciption in WEB show:
[−2^31,  2^31 − 1]

@halu886 Thank you for reporting.
This issue is dup with #74


Provide capability to create a Logic App

Is your feature request related to a problem? Please describe.
Extend LogicAppClient to create a Logic App
Describe the solution you'd like
As we already have the capability to update and delete a Logic App, we should also provide the capability to create a Logic App.
This can help in setting up Logic App's for test purposes and delete them after the tests have ran.

As the LogicManagementClient only supports .CreateOrUpdateAsync, we already have this set up in the .TemporaryUpdateAsync. Which means that also new logic apps can be created this way.
Maybe we should rename this or create a new method that is specifically called .TemporaryCreateAsync but calls .TemporaryUpdateAsync behind the scenes.

I think we should have an alternative method which is more clear, users don't know what's used under the hood indeed.
If this is solely for creating temporary Logic App instances I think this is fine, but is that truly the case @mbraekman or do you need it for other scenarios as well?

In the end, creating Logic Apps through this Fx will be something to only exist temporarily, however in some cases you want to create a specific Logic App (for logging/for triggering/...) as part of the 'TestInitialize'-method to only be deleted in the 'TestCleanup'-method, which won't allow you to use the TemporaryCreate/Update methods.
Performance-wise it wouldn't make sense to me if you have to create/delete a Logic App per test-scenario, while this could be reused.

So you're saying a temporary create is not enough or am I understanding it wrong?

@tomkerkhove, that would've been the sort answer, yes 😄

Well, you could keep track of the disposables, but that is maybe not really readable. I'll look at it!

@mbraekman , could you give some guidance as what I should have in order to test this? bc, I figure that I can't use the existing two Logic Apps from the integration tests, as we're creating a new workflow here?


feat: Syncing TypeVariableKind with Kind

Description
Problem*
Resolves https://github.com/noir-lang/noir/issues/6067
Summary*
Additional Context
Documentation*
Check one:

[ ] No documentation needed.
[ ] Documentation included in this PR.
[ ] [For Experimental Features] Documentation to be submitted in a separate PR.

PR Checklist*

[ ] I have tested the changes locally.
[ ] I have formatted the changes with Prettier and/or cargo fmt on default settings.

Note: this is expected to fix https://github.com/noir-lang/noir/issues/6125


Look into creating default functions that call graphics to replace override

Replace override with lines.default (for example)? This could help us grab their help files (import documentation).

@ldecicco-USGS could you elaborate on what you mean here?

Sure, find me sometime tomorrow.


[ML-305] Deleted LymphomaDS and references

LymphomaDS is local to developer
Other references doesn't contribute any new information in the absence of a wide dataset. Iris was the replacement for LymphomaDS but it has only 3 attributes.
This is also related to pull request  #243

@johnholt Please review

Reviewed.  @richardkchapman  OK to merge


Dynein light intermediate chain binding

Hi--
I'd like to request an additional is_a child term for
dynein binding: dynein light intermediate chain binding.
Def.: Interacting selectively with a light intermediate
chain of the dynein complex.
--dynein binding, GO:0045502
---dynein light intermediate chain binding, GO:new
This term is needed to curate information from
PMID: 14697201.
A reference describing dynein subunits, including the
light intermediate chains is: PMID: 16440056.
Thanks,
Kimberly
Reported by: vanaukenk
Original Ticket: "geneontology/ontology-requests/3259":https://sourceforge.net/p/geneontology/ontology-requests/3259

thanks www.movied.org


How to check connection to google maps api

HI,
Is there any function to check if API Key is correct and connection to google maps API can be made ?
Best Regards
Michal

+1
Also i'ld like it to debug my app: for me mac osx tutorial not works, i get the same result as in #752 and in google developer console i see 0 requests; so i'ld like to know if there's a problem with API key or with service.

Yes, there is. If you have a grey map with the Google logo visible, the plugin works but your key is wrong. No map (nor Google logo= Other problem)

Thanks but how can i check it programmatically ?

There is no way

@Hirbod i solved my issue simply using version 1.3.4 instead the latest

Please do not mix up issues. @adaniello

sorry! only to inform you

Actually in my test cases, the current master works perfectly by the way.


Implement automatic update

Proposed by Fantos.
Sounds complex, is complex.
This requires to check the repo and compare versions to make toast notification in editor (easy).
If automatic download is also needed, the plugin must be disabled, and a helper must remove the old plugin and/or update files according update. (hard)
I think would be easy to do if we used git directly?

relevant godot proposal https://github.com/godotengine/godot-proposals/issues/8451

Hi there, I have also found this difficult to do with my plugin in Godot. I just released a plugin to do that in mine.
I made a plugin-plugin that can add plugin updates to your plugin. Check it out: https://github.com/myyk/godot-plugin-updater
It might not be everything you wanted, but it likely is about 80% of what you want.

Hey, that's a very handful plugin, I'll take a look at it. Thank you :D


"Edit dependencies" dialog is not showing up if .tscn scene is already opened

Operating system or device - Godot version:
Arch linux -- Godot master
Issue description (what happened, and what was expected):
I opened a .tscn scene, and attempted to check its dependencies, but when I clicked the menu option, nothing showed up. It works properly with .xscn.
Steps to reproduce:
Create .tscn scene, open it, and add a few nodes (like Sprite) and assign them an external resource.
Open the scene, then right-click in the FileSystem tab, and select "Edit Dependencies".
Observe that nothing happens, then close the scene and retry.
Repeat the same with .xscn or .scn. Observe that it works good.
Link to minimal example project (optional but very welcome):

On Windows I get the dialog plus this warning:

Hm... then it is either specific to this projects (or 2.0-alpha project in general), or it is linux-only....

@bojidar-bg Please provide a minimal example ;)

Uhh... it is getting stranger, I bet it is some uninitialised variable somewhere, since I am able to reproduce it at random.
Here are some more details:

The main scene is res://scenes/main_menu.xscn made with 2.0 or earlier (it is an old project).
I proceed to open another scene, res://editor/editor.tscn, made with relatively recent master versions
Then I select "Edit dependencies", and sometimes it would fail to work.

If it works the first time, it displays a message like @vnen's, but then fails the second time, 100% reproduction rate.
After the first failure, it won't work until another item (e.g. res://editor/editor.gd) is selected in the FileSystem view, and then the same operation is repeated on the scene.
After it works once, it would continue working indefinitely until an editor restart.

Also, I tried reproducing on minilens with res://menu/menu.tscn and res://main/main.tscn -- It worked on the main scene all the time. Maybe it is related to the FileSystem dock?
I hope you would be able to reproduce it this time :smile: .

I can't reproduce in any way or form...

Might be the case of something pretty weird in my project, I would try reproducing on a clean one soon

@reduz @akien-mga Here is a sample project:
5521-edit-deps-not-showing.zip
To reproduce:

Start godot inside the folder as editor (godot -e). I tested with both release_debug and debug builds.
Navigate the FileSystem dock to the res://other folder
Open res://other/Other.tscn
Without changing the focus, right-click on the file in the FileSystem dock, and select "Edit dependencies".
If it works the first time, hit Esc a few time to close it and repeat
Observe that the "Edit dependencies" window doesn't show at all.

If you can't reproduce it after this, you are free to close the issue as invalid -- probably I messed something as well :smile:

Could not reproduce in master.


libsass: 3.4.9 -> 3.5.1

Semi-automatic update generated by https://github.com/ryantm/nix-update tools. These checks were done:

built on NixOS
Warning: no binary found that responded to help or version flags. (This warning appears even if the package isn't expected to have binaries.)
found 3.5.1 with grep in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1
found 3.5.1 in filename of file in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1

cc @codyopel @offlinehacker for review

Success on x86_64-darwin (full log)
Attempted: libsass
Partial log (click to expand)
make[2]: Entering directory '/private/tmp/nix-build-libsass-3.5.1.drv-0/libsass-3.5.1'
make[2]: Nothing to be done for 'install-exec-am'.
make[2]: Nothing to be done for 'install-data-am'.
make[2]: Leaving directory '/private/tmp/nix-build-libsass-3.5.1.drv-0/libsass-3.5.1'
make[1]: Leaving directory '/private/tmp/nix-build-libsass-3.5.1.drv-0/libsass-3.5.1'
post-installation fixup
strip is /nix/store/4sdh09gmvl15cy0zb6i7mbvxh5syz206-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/5grnhkfm4k2zih8vmczdsd1npf8yj5nx-libsass-3.5.1/lib
patching script interpreter paths in /nix/store/5grnhkfm4k2zih8vmczdsd1npf8yj5nx-libsass-3.5.1
/nix/store/5grnhkfm4k2zih8vmczdsd1npf8yj5nx-libsass-3.5.1

Success on x86_64-linux (full log)
Attempted: libsass
Partial log (click to expand)
make[2]: Leaving directory '/tmp/nix-build-libsass-3.5.1.drv-0/libsass-3.5.1'
make[1]: Leaving directory '/tmp/nix-build-libsass-3.5.1.drv-0/libsass-3.5.1'
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1
shrinking /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1/lib/libsass.so.1.0.0
strip is /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1/lib
patching script interpreter paths in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1
checking for references to /tmp/nix-build-libsass-3.5.1.drv-0 in /nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1...
/nix/store/k68941z8m2pw5jgmc0f7f2k9x0iv2pcj-libsass-3.5.1

Success on aarch64-linux (full log)
Attempted: libsass
Partial log (click to expand)
make[2]: Leaving directory '/build/libsass-3.5.1'
make[1]: Leaving directory '/build/libsass-3.5.1'
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1
shrinking /nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1/lib/libsass.so.1.0.0
strip is /nix/store/lvx1acn1ig1j2km8jds5x3ggh3f2wa8v-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1/lib
patching script interpreter paths in /nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1
checking for references to /build in /nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1...
/nix/store/rc3sjqb2ymvkd71i0qvjv9f5np13dhia-libsass-3.5.1


Request and Response based metrics

[x] Requests per minute/second: global counter
[x] Requests per minute/second: path aware counters
[x] ResponseCode per minute: global counters for each ResponseCode

#10


Filters not working with pagination

Unless I missed a step somewhere, filters are reset when changing pages.
It can be solved with saving the filters in the session, although personally I think filters make more sense as GET parameters.
In any case, I don't see a way of choosing which checkboxes are pre-selected based on filters set on the previous page.

Yeh, it should be in the URL, either GET parameters or the URL segments (which is more difficult to implement, although looks nicer).

@daracorcoran, this bug should now be fixed, could you test it and close it?


The Map will be pretty laggy when the length of points is bigger then 5000 and the points is close,especially when I custom the markers

Steps to reproduce

init datas more then 5000 and make the points very close.
custom the markers like to set a icon.
zoom the map to show the markers until the poinst is all spread.
and then zoom back to normal,keep repeat the step3 and step4 for several times.

Code example
const markers = locations.map((position, i) => {
      const dotSize = 2;
      const latlng = new google.maps.LatLng(position.lat, position.lng);
      const marker = new google.maps.Marker({
        position: latlng,
        icon: {
          path: `M 0, 0 m -${dotSize}, 0 a${dotSize},${dotSize} 0 1,0 ${dotSize *2 },0 a${dotSize},${dotSize} 0 1,0 -${dotSize * 2},0`,
          fillColor: 'red',
          fillOpacity: 1.0,
          scale: 1,
        },
        map
      });
      return marker;
});

new MarkerClusterer({ markers, map });

This is expected behavior that is likely due to known performance issues in the Marker class when dealing with large volumes of markers. Usually >300 or so will start to see degraded performance, so it's not too surprising you're running into it with thousands of markers.
If you need that scale, you could consider something like this IconLayer clustering example with deck.gl.

All right, thanks for your reply, it shows "a large number" on the official website of Google Map,I misunderstood it.I think the description should be revised to make the description more accurate and avoid similar puzzled.


[WIP] Export data mappings

How to categorize this PR?

/area usability
/kind enhancement
/priority 3
What this PR does / why we need it:
Adds an implementation of the exportDataMappings which are already described in the documentation.
Special notes for your reviewer:
Release note:

Installation's `exportDataMappings` field now works as described in the documentation.

/test

/test

/test

/test

/test

/test

@reshnm Do we have to add this to the installation simulator, or is it already implemented there?


Download only as needed

This PR adds a small change that makes prefill do a HEAD request, and check if X-Cache-Status is set to HIT. If it is, then it can safely skip and move onto the next chunk. Avoids unnecessary downloads from the cache server.

This is useful, for instance, when a download is interrupted. As some modern games can be as large as 100+ GB, and while steam has many, many chunks and URLs to check, this still speeds up the process of resuming the download, or skipping games that the cache already has.

Thanks for the pr. I'll probably be able to take a look at this in the next few days or so.  Will let you know any feedback then

After some updates have released, i have confirmed my patch holds up to those as well, only downloading the changed stuff, and skipping by the rest that the cache already has. Hope this makes it in.

I've finally been table to take some time to check this out, and test it out a bit.  It does work and certainly speeds up things by a lot!  However I have two reservations about including these changes:

This change breaks the benchmark command's functionality.  Since clients would no longer be pulling the actual download over LAN, then running a benchmark as a client will produce incorrect results.  Running this as a client on my desktop achieved speeds of over 450gbit/s which would never be possible by a single client.  Keeping the benchmark functionality is very important as it is depended on by the community to identify bottlenecks in their setups.

I am also a bit cautious to change the download behavior to be different than what the Steam client itself does.  SteamPrefill has always been intended to match the real client's behavior as much as possible, so that there can be the confidence that downloading via Steam/SteamPrefill will have the exact same result.

Hmm perhaps put this behind a command line toggle then to not break the default behavior of other commands?

I can modify this to put it behind a command line toggle, or just fix it so that benchmark and other such commands will not utilize the HEAD request check.

Are you on discord?  Would you maybe be interested in joining the lancache discord and chatting about this a bit there?

Yea i'm on discord.

I updated the files in the PR. I added a command line toggle to turn on skipping chunks that have already been downloaded. Updated it to be compatible with upstream/master. By default, this will use the current behavior of not skipping chunks.
I wasn't sure where the best place for this toggle would've been. Nor was i sure what the best nickname for the flag was.


Windows - reqwest error

Running bb.exe on a Windows 10 machine, using the following command (elevated prompt):
bb.exe --config D:\utilities\bb\config.json movies sync
returns this error:
Error: reqwest::Error { kind: Decode, source: Error("invalid type: null, expected a string", line: 1, column: 351761) }
the config file contents are:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "****redacted****"
}

Duplicate of my ticket. At least I'm not the only one having the issue. Have you tried a different OS?

So I have radarr disabled in Bazarr but I went ahead and ran, "bb --config config.json movies sync" and it worked. It showed 0/0 but it still worked.
user1@docker:/opt$ sudo bb --config config.json movies sync
[############################################################]       0/0
Finished performing action sync on all movies

Radarr (and Sonarr) are and have been active in my Bazarr install; not sure why having it disabled would work, that doesn't seem to make sense. I'll attempt it with TV later today and we'll see how that goes.

I tried earlier today to disable Sonarr and it didn't make a difference. The script gave the same error. It's a waiting game until we hear from @mateoradman

Hi, thanks for reporting the issue. I will look into it and push a patch as soon as possible 🙂

Tried this a few different ways, with one positive result.
Same config as before, but trying TV instead of movies, same type of error.
command:
bb --config config_bb_165.json tv-shows sync
error:
Error: reqwest::Error { kind: Decode, source: Error("invalid type: null, expected a string", line: 1, column: 39647) }
config file:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "***redacted***"
}

Running bb on second instance of bazarr, set up for 4K movies (no TV), for which all media files are on the same PC, therefore same IP address - it worked.
command:
bb --config config_bb_169.json movies sync
result:
[############################################################]     132/132
Finished performing action sync on all movies

config file:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "***redacted***"
}

For the first instance of bazarr, which handles both movies and tv shows, the media files reside on two separate PCs. Paths are set correctly and bazarr can see all media on both PCs and has pulled down subtitles for both movies and tv shows for the media files on both PCs.
So figure might as well try adding user/password to the config file along with a change in protocols from 'http' to 'https' to see if that helps with the fact that the files are spread over two PC, therefore two separate IP addresses; nope, errored out again, but different error message.
with user/pw added to config
command:
bb --config config_bb_165.json movies sync
Error: reqwest::Error { kind: Request, url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv4(<IP_ADDRESS>)), port: Some(6767), path: "/api/movies", query: None, fragment: None }, source: hyper::Error(Connect, Ssl(Error { code: ErrorCode(5), cause: None }, X509VerifyResult { code: 0, error: "ok" })) }

config file:
{
  "host": "<IP_ADDRESS>",
  "protocol": "https",
  "port": "6767",
  "apiKey": "***redacted***",
  "username": "***redacted***",
  "password": "***redacted***"
}

ok, tried same thing, but switched back to 'http' as protocol but left username/password in, and original error message gets repeated.
command:
bb --config config_bb_165.json movies sync
error:
Error: reqwest::Error { kind: Decode, source: Error("invalid type: null, expected a string", line: 1, column: 351795) }
config:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "***redacted***",
  "username": "***redacted***",
  "password": "***redacted***"
}

So, one possibility is that the bb app will work as is, but only if the media files for bazarr are on the same physical PC/IP.

@WallaWallaWA thank you very much for your effort in debugging this problem.
Could you please compare the versions of the two bazarr instances that you have up-and-running. Is the version of bazarr that worked different than the one that didn't? In your example, I suspect that Bazarr running on <IP_ADDRESS> is older than the one running on <IP_ADDRESS>.

Both are 1.40, so same version.

Hi @WallaWallaWA and @JuniperMS, please try with the new version (v0.1.2) again and let me know how it goes :slightly_smiling_face:

@mateoradman it seems to be working!

So figure might as well try adding user/password

@WallaWallaWA, I've researched this a bit and even though I set up authentication in Bazarr with a username/password, I was still able to run bazarr-bulk using just the API key. It seems that the API key is sufficient to run these operations regardless of your UI authentication settings. Therefore, no username and password are needed in the configuration JSON file.

@mateoradman seems the fix is good. Note, I only tested this on Linux. I didn't want to test on Windows and instead wait for @WallaWallaWA to test that portion. Many thanks for the swift fix!

On Windows 10, from an elevated prompt, using bb vers 0.1.2
bb command
D:\utilities\bb\bb.exe --config D:\utilities\bb\config.json movies sync
output:
Bazarr API is healthy
[##########################################################] 4198/4198
"Successfully performed action 'sync' on English subtitle of movie xxxxxx" displayed for each movie
Finished performing action sync on all movies

config file:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "***redacted***"
}

Didn't really time it, but my estimate is that it took about 40 minutes to complete. Note that some of those movies, especially older ones (and some silent films), do not have subtitles, so presume those were skipped as the screen prompt moved through some in less than a fraction of a second. Another guess, based on watching the screen prompts, is that it took 2-3 seconds to sync a subtitle, so this is very fast.
I'll try this later today or tomorrow, dependent on time availability, and run this on the Ubuntu box, that run will be for tv shows (approximately 470 shows, about 28,000 episodes) just to confirm it's working on a linux system with media files on windows machines.
Thanks for the quick response and the fix!

running on Ubuntu (22.04.03 LTS)
bb version 0.1.2
command:
bb --config config.json tv-shows sync
response:
Bazarr API is healthy.
[###########################################] 470/470
"Successfully perfromed action 'sync' on English subtitle of episode XXXX" returned for each show/episode
Finished performing action sync on all tv shows

config file:
{
  "host": "<IP_ADDRESS>",
  "protocol": "http",
  "port": "6767",
  "apiKey": "***redacted***"
}

So, no errors or other issues; not sure how long it took to run as I didn't babysit this run as I did with the movies earlier, but my best guess at a rough estimate is 2 hours. Thanks for developing this terrific utility, it's a feature that's sorely missing from Bazarr.


Update gradle to be more stringent with javadoc

Modify the build.gradle script to fail on javadoc warnings. This is useful because we aim to have a complete documentation of our library, and this may help to fail the javadoc build to point out warnings.
Closes #20

Codecov Report

Merging #20 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #20   +/-   ##
=========================================
  Coverage     93.56%   93.56%
  Complexity       62       62
=========================================
  Files             6        6
  Lines           171      171
  Branches         19       19
=========================================
  Hits            160      160
  Misses            8        8
  Partials          3        3

Impacted Files
Coverage Δ
Complexity Δ

...ava/org/magicdgs/hdf5j/io/address/FileAddress.java
100% <ø> (ø)
15 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update aa0d2f9...6a6505c. Read the comment docs.


--http3 does not work together with --ech

--http3 does not work together with --ech
http3 will work but not ech
Originally posted by @likev in https://github.com/ameshkov/gocurl/issues/14#issuecomment-1745202902
Fixing this requires using Cloudflare's fork of quic-go.

@nekohasekai have made a tested fork of quic-go that supports ECH. ECH support is extracted from crypto/tls in cloudflare/go.
Source: https://github.com/SagerNet/quic-go/commits/dev
_Originally posted in https://github.com/quic-go/quic-go/issues/3905#issuecomment-1700389609


Add redirects for explorers migration

Adds redirects from redirect mapping spreadsheet in https://github.com/netlify/marketing/issues/2291
I'm not sure where the explorer site is hosted. I can only find the internal "netlify-explorers" site when I search in the app.

@hexagoncircle is there a way we can test these redirects before merging? it doesn't look like any deploy preview urls (https://deploy-preview-529--explorers.netlify.app/ are redirecting

Oh nice! I didn't see that the deploy preview built. @stephan1echung—yes, my fault. I included the domain in the redirects when we just want it to be relative paths. I just pushed a change. We should be able to test these redirects once the deploy preview is ready

Thanks @hexagoncircle ! It looks like https://deploy-preview-529--explorers.netlify.app/api/get-stage-data returns a 200 status code instead of a 404 status code. will that be handled in a separate PR?

@stephan1echung, ah I didn't realize that needed to be done as well! I've moved the api folder out of the page build so all of those api pages should 404: https://deploy-preview-529--explorers.netlify.app/api/get-stage-data

From the contributing doc:

All PRs need to be approved by one of the CODEOWNERS

I think we need @netlify/developer-experience @netlify/department-developer-experience to review and approve this before merging. Neither of those handles seem to link so this codeowners file may be outdated 🤔

From the contributing doc:

All PRs need to be approved by one of the CODEOWNERS

I think we need @netlify/developer-experience @netlify/department-developer-experience to review and approve this before merging. Neither of those handles seem to link so this codeowners file may be outdated 🤔
@philhawksworth, are you able to help us merge this work?

Yes, I'll review. Thanks!

Required PR Labels Expected — Waiting for status to be reported

I'm not sure what this task is waiting for. @philhawksworth, do you have admin access to this repo's settings?


Is there a way to create a Spaced Clustered Vertical Stacked Bar with 'Hierarchical' X axis labeling

I want to create something like this.

Similar to Vertical stacked bar graph with clusters
Cluster value would be "Divison A", "Divison B", "Division C"
Y values are stacked as represented by the different colored bar segments
X - ordinal values are the dates (correspond to weeks)
Key difference are:

Want spacing between each cluster bar for a given x ordinal value
Want a hierarchical labeling along the x - axis with each cluster value visible "Division A" etc but also
want the X ordinal values labels to the "encompass" the cluster values "December 22 2017" etc.

we don't have a high-level way to do that.
however, with tickValues and tickFormat, and possibly several XAxis components, you could do that.
let's suppose your bars have an x value from 0 to 8. so [{x: 0, y: ...}, {x: 1, y: ...}, etc.]
you could have:
<XAxis tickValues={[0, 1, 2, 3, 4, 5, 6, 7, 8]}
tickFormat={d => ['Division A', 'Division B', 'Division C'][d % 3]}
/>
<XAxis tickValues = {[1, 4, 7]}
tickFormat={d => ['December 22 2017', 'December 29 2017', 'January 5 2018'][(d - 1) / 3 % 3]
/>
Here I'm using % as a hacky way to create a function that would transform the tick values into the desired label.
If you have the data set accessible as an array and the division name or the date are present it could be something like
tickFormat={d => data[d].division}
hope it helps


Precompute as much of the Cubemap filter on the CPU to reduce GPU usage and improve performance.

This greatly simplifies the work required to filter cubemaps by doing the calculation once on the CPU instead of doing it for every pixel in the environment cubemap.
This is especially important on mobile and integrated graphics. For dedicated graphics, the difference is not so apparent as they can churn through calculations so fast they are bottlenecked by the texture reads anyway.
This optimization could be ported to the Vulkan renderer, but the benefits will likely be less apparent.
On my mid range IGPU (intel i5-8265U) this reduces the cost of updating cubemaps by approximately 3 ms.

Is this optimization also relevant for 3.x?

Is this optimization also relevant for 3.x?

It could be backported!

Thanks!


Copy back ACL

Since this repository has no license it's better safe than sorry to ask:
Could I add that acl set onto my razer blocking script? Thank you

Of course!


[Kick.com] multi-thread

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm asking a question and not reporting a bug or requesting a feature
[X] I've looked through the README
[X] I've verified that I'm running yt-dlp version 2023.03.04 (update instructions) or later (specify commit)
[X] I've searched known issues and the bugtracker for similar questions including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Please make sure the question is worded well enough to be understood
Hello,
I'm trying to download a VOD from Kick.com but sadly it's very long to just do: yt-dlp.exe -f 720p60 https://stream.kick.com/.../master.m3u8 like you might now !
I was wondering if there was a way to multi-thread that from the cli or if I need to open a feature suggestion ?
Thanks !
Provide verbose output that clearly demonstrates the problem

[ ] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[ ] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
No response

does --concurrent-fragments 16 (or whatever number) work?

if not, please post a verbose output

-concurrent-fragments 16

There the verbose output for:

yt-dlp.exe -f 720p60 https://stream.kick.com/ivs/v1/196233775518/u2Tc00FhozOp/2023/5/26/19/52/gt7idvnDeh2T/media/hls/master.m3u8 -concurrent-fragments 16 -v

>
[debug] Command-line config: ['-f', '720p60', 'https://stream.kick.com/ivs/v1/196233775518/u2Tc00FhozOp/2023/5/26/19/52/gt7idvnDeh2T/media/hls/master.m3u8', '-concurrent-fragments', '16', '-v']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version<EMAIL_ADDRESS>[392389b7d] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19045-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg 6.0-full_build-www.gyan.dev (setts), ffprobe 6.0-full_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.17, brotli-1.0.9, certifi-2022.12.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1786 extractors
ERROR: Fixed output name but more than one file to download: ncurrent-fragments

-concurrent-fragments

needs to be --concurrent-fragments

-concurrent-fragments

needs to be --concurrent-fragments

Oh yeah sorry I failed in a simple copy paste !

It's way better thanks !


Support overriding blocks in CRUD views

Hi,
This PR allows users to quickly change any block in a template without having to overwrite the whole template. For example, if you'd like to change the page title, name and description, you just need to set:
from cruds_adminlte.crud import CRUDView
from django.utils.translation import ugettext_lazy as _

class MyView(CRUDView):
    from .models import MyModel
    model = MyModel
    template_blocks = {'title': _('My fancy page title'),
                       'page_name': _('Some results'),
                       'page_description': _('Details')}

Merged! Thanks @mbourqui for the work.


ZEPPELIN-3745. Disable CRC check of hadoop FileSystem

What is this PR for?
Trivial PR to disable CRC check of hadoop FileSystem, otherwise we may get error if we manually change the file content of interpreter-setting.json
What type of PR is it?
[Bug Fix]
Todos

[ ] - Task

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-3745

How should this be tested?

CI pass

Screenshots (if appropriate)
Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

+1 lgtm


Day242

Resolves #498.

Pull Request Test Coverage Report for Build 926

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 924:
0.0%

Covered Lines:
5

Relevant Lines:
5

💛  - Coveralls

Pull Request Test Coverage Report for Build 935

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 924:
0.0%

Covered Lines:
5

Relevant Lines:
5

💛  - Coveralls


Fund your wallet after setup

https://bitcoin.design/guide/daily-spending-wallet/first-use/#initial-deposit
If a new wallet is created rather than an existing seed recovered, provide a dialog with instructions how to make a test deposit to their Bails.


YAML support is needed.

Currently the reader only reads JSON OpenAPI specifications.

YAML support was added with this commit.

Confirmed with a unit test in this commit.


Problem loading PixArt Sigma .safetensors + 2k support?

I seem to have issues loading the safetensors versions of PixArt Sigma as per below.
Separately, is the 2K model supported as yet?

Did you update the node pack? It should work on latest and that error message seems off.

Reinstalled the node. Working now, although the 2K Sigma model gives garbled output. I guess that's not yet supported?
Thanks!

I guess that's not yet supported?

There should be an option for it in both the model loader and the resolution selection dropdowns. PixArt seems to only work with the resolutions it was trained on.


Support importing from other versions of STAC metadata

User Story

So that I can easily import my existing datasets in the Data Lake 2, as a Aerial Imagery Maintainer, I want to import my data and metadata from STAC 0.8.1 format (and converting to current DL version?)

Acceptance Criteria

[ ] Given STAC metadata 0.8.1 or later, when I start an import, then metadata is validated (or converted?) to current DL STAC profile version
[ ] Given [a pre-condition], when [an event happens], then [an expected outcome occurs]

Additional context

This? https://www.skypack.dev/view/@radiantearth/stac-migrate
Steps to manually update Aerial Imagery metadata (v0.8.1) to 1.0.0-rc.1:

Add "type": "Collection",
Change "stac_version": "0.8.1", to "stac_version": "1.0.0-rc.1",
Change NZ Aerial Mapping url from "url": "unknown" to "url: "https://www.linkedin.com/company/nz-aerial-mapping-limited-sa/"
Change datetime format from '2003-01-01 00:00:00.000Z' to '2003-01-01T00:00:00.000Z'

Tasks

[ ] ...
[ ] ...

Definition of Ready

[ ] This story is ready to work on, according to the team's definition

Definition of Done

[ ] This story is done, according to the team's definition

This will likely be done outside the geostore product. Closing.


New API request: remove jobcreator by class name not instance

Hi,
is it possible to provide an API for removing a JobCreator via class and not instance, i.e.
JobManager.instance().removeJobCreator(MyCreator.class).
The point is, that in some cases jobcreators are added and removed dynamically under special circumstances and it is not always easy to hold that instance of the jobcreator somewhere without using a static field. Or do you have another idea how to solve this problem?

I don't see a problem to make job creators singletons. You also only need to overwrite the equals() method of your job creator to make the check pass (what is kinda dirty, though).

Hmm, I would like to avoid singletons, we have a high modularized app where (independent) features are activated / deactivated on demand and each feature has its own jobcreator.
Maybe i will find another approach, thank you.

Your approach with classes wouldn't work well. What should happen if you add two instances of the same type? What if CreatorA extends CreatorB and you remove CreatorB.class? What should happen if you remove Object.class?
You don't need a singleton. Store you instances somewhere in a field and later remove those. In the end they need to be stored somewhere.

Two instances of same type doesn't make sense for me, that's a users' fault, inheritance could be a problem, but here I would suggest to compose objects and not to inherit (can also be handled by user),
but I see that's not easy for a library to expect that every user follows specific patterns.
Object.class is really a point hat i didn't consider and don't have an idea yet.


Updating from 3.9.1 to 3.10.1 throws System.MissingMethodException

Updating from 3.9.1 to 3.10.1 started throwing the below exception:

System.MissingMethodException: Method not found: 'System.String Microsoft.Azure.Documents.PathsHelper.GeneratePath(Microsoft.Azure.Documents.ResourceType, System.String, Boolean, Microsoft.Azure.Documents.OperationType)'.

Here's the full stack trace:
exception.txt

Hi @petro2050,
Can you provide a console app that reproduces this? It seems to be referencing this code, and all the gates are passing. The only idea I have right now is there is a stale dll like Microsoft.Azure.Cosmos.Direct.dll that is cached. Can you try to do a clean and rebuild?

Do you have a solution with multiple projects that reference each other? Is the SDK being included in multiple of these projects? Can you verify if the versions of the SDK across these projects are the same or you are using binding redirects?

I'm deploying a Function app, so I believe there was a stale dll somewhere. I did a clean and rebuild, and it fixed the issue.


Update root_command.py

removed some useless space
Rationale

Summary of changes made

Checklist

[ ] This PR changes the jishaku module/cog codebase

[ ] These changes add new functionality to the module/cog
[ ] These changes fix an issue or bug in the module/cog
[ ] I have tested that these changes work on a production bot codebase
[ ] I have tested these changes against the CI/CD test suite
[ ] I have updated the documentation to reflect these changes

[ ] This PR changes the CI/CD test suite

[ ] I have tested my suite changes are well-formed (all tests can be discovered)
[ ] These changes adjust existing test cases
[ ] These changes add new test cases

[ ] This PR changes prose (such as the documentation, README or other Markdown/RST documents)

[ ] I have proofread my changes for grammar and spelling issues
[ ] I have tested that any changes regarding Markdown/RST syntax result in a well formed document

This space is NOT useless - if you went and tested this change you would see that the text becomes incorrectly formatted because there is no longer a space bridging from the previous part. Please actually test before contributing - the checklist is not just a decoration.


Add a LICENSE

Given that the site has a lot of articles now, I think a license for the code and for the articles should be added.

Apache 2.0 added.

Given that the Apache license is for code, I think licensing the articles (which are not code, but other creative work) by CC0 would be cool. CC0 basically means public domain.

Added, now this project has become multi licensed project.


replace ramda with welshman/lib

#372
Replaced most of ramda utilities with either welshman/lib or standard JS functions.
takeWhile might deserve its own implementation in welshman/lib.

Merged manually


How to check allowed ROLE? allow or deny('ROLE') not working.

Hi Guys,
How to check a user role like permission (check / checkPemission)?
The method allow or deny('ROLE') not working.
Some observation?
Thanks 4 all!

Please reference this link, you can call hasRole or hasAnyRole methods.


Draft list of book search fields and relative priority

Refer to PUL solr index configuration and look at what fields we have available. Come up with a preliminary list and then share for review/refinement.

@jkotin I looked at the Solr configuration for the PUL catalog search. Here are the fields it includes that I think are relevant for us to keep in mind (listed in priority order):

title
author
subject
isbn
description

I propose that we include the following fields in our keyword search for books (listed in priority order):

author
title
editor
translator
subjects
genre
format
public notes

I put author first because my sense is that if someone searches on an author like Joyce in this collection they would want to see works by him first, not works about him where he is mentioned in the title. (I'm not sure how many cases we have where a name can appear as both a creator and a title word.) Do you agree with this?
Including subjects and genre will require some data work, but seems like they would make the search more interesting.  (FWIW, I think you should be able to clean these up substantially by removing the ones you don't care about, e.g. all the "provenance" and "binding" terms). If we include these in the search they should also be listed on the book detail page - I can't remember if we've discussed that previously.
I propose including format because it will give you a way to search for periodicals. The only downside is that I don't know how well it will combine with the other search terms - i.e., it might only be effective if you only use that search term, since otherwise I think you will get all periodicals and all items that match your other search terms.
The PUL Solr configuration includes unstemmed variants of each field (higher priority) and then stemmed versions, which means that more specific versions of words will be marked as more relevant. I recommend we do the same (probably applies to all fields except format).

@rlskoeser This proposal looks great to me.  I agree about author>title.  Some questions/comments:

What about other creator types—editor, illustrator, etc?

I think the generic/problematic titles might create interesting scenarios.  For example, we have a generic title, "Paris." I suspect people will search for "Paris" and "Mirrlees" or "Hope Mirrlees."  That generic "Paris" would, ideally, be near the top of the results.  Is there a way to use public notes to make that happen? Another example: we have a problem title ""Agamemnon, Oedipus." Ideally that would show up for searches for Aeschylus or Sophocles.

We should talk about the work required to make the subjects and genre useful for searches.

Would it be possible/advisable to original language?  E.g. search for "spanish" and find the books originally written in Spanish.

I don't think the other creator types should be more important than title, if that is what you're asking. I think it would be confusing.
A match on the title (like "Paris") should put the result at the top of the search. If you want a record to be findable by search terms not otherwise associated with the record, you should try to include them in the public notes. I think the "Agamemnon, Oedipus." search can also be solved by a public note — and these are some good test cases to keep in mind when you test the relevance ranking on the book search.
Do you want exclude or include subject and genre for now? If you think you may want them, I recommend we include now because it might be hard to revisit.We can discuss at an upcoming meeting, but I would like to have an initial answer sooner. This decision also impacts other parts of the site / project, notably book detail/bibliography page and and book data export, and if we include them in the book data export it gives you a deadline for at least a first-pass cleanup of the metadata.
We don't include original language anywhere in our book data. (I checked and saw a note in the code that we might add languages in future.) If there are books where this is important you could include it in the public notes.

I just wanted to be sure that the other creator types are included. (They aren't on your list.) I definitely agree that they shouldn't be more important than title.

Perfect.

I would like to include subject and genre. I am wary of the work/judgment involved in choosing from the OCLC list. Maybe we could have a phone meeting about this?

Makes sense to me.

Thanks for clarifying about other creator types I included editor and translator but forgot illustrator. Do we have any other creator types, or do you expect to add any others? Wondering if I need a catch-all creator field to ensure that any creators are always included in the search.

We also have "preface" and "introduction." A catch all might make sense.

@jkotin great, good to know. Do you want any of the creators besides authors to have higher relevance, or can I just use a catchall creator field for all of them?

Catch all creator is fine with me.  So author, title, other creators -- in that order.

Decision: exclude subject and genre for now (determined they are not MVP / not 1.0).

Documented the agreed upon fields in #226


add default headerContainer tabHeight param

Hello @xaldarof
I appreciate your intention to contribute.
I've checked  your changes and I don't believe that can improve the package, so I'm going to close this PR.
Nevertheless, I would like to recommend an approach in order to get similar results in terms of boilerplate reduction.
  // declare a reusable function
  final createTabHeightBuilder =
      (double height) => (BuildContext context, Widget child) => SizedBox(
            height: height,
            child: child,
          );

  // build
  return Scaffold(
    appBar: AppBar(),
    body: ScrollableListTabScroller(
      headerContainerBuilder: createTabHeightBuilder(100),
      ...
    ),
  );

Thanks for the response. Yes, I'm aware of this parameter, but it would be perfect if I could set only the height of the tabBar and not the entire tabBarContainer.

I realized that some developers don't need full customization with builders, so I created a new constructor to keep it separate from the other approach.


CI: Terraform Randomly fails with creating KMS Alias (alias/eks/cbci-bpxx-ci-xx-eks): AlreadyExistsException

Description
From time to time, the terraform command fails with
Error: creating KMS Alias (alias/eks/cbci-bp01-ci-v2-eks): AlreadyExistsException: An alias with the name arn:aws:kms:us-east-1:324005994172:alias/eks/cbci-bp01-ci-v2-eks already exists

with module.eks.module.kms.aws_kms_alias.this["cluster"],
on .terraform/modules/eks.kms/main.tf line 255, in resource "aws_kms_alias" "this":
255: resource "aws_kms_alias" "this" {

It only happens in the CI pipeline that it using a s3 as backend.
If your request is for a new feature, please use the Feature request template.

[X] I have searched the open/closed issues in this repository and my issue is not listed.
[ ] I have checked that local tests are passing.
[ ] If the issue is related to an AWS EKS add-on, I have searched the open/closed issues in the upstream aws-ia/terraform-aws-eks-blueprints and my issue is not listed.
[X] If the issue is related to an AWS EKS add-on, I have checked that upstream tests for the eks terraform blueprints add-on are passing.

⚠ Note
Before you submit an issue, please perform the following first:

Remove the local .terraform directory (! ONLY if state is stored remotely, which hopefully you are following that best practice!): rm -rf .terraform/
Re-initialize the project root to pull down modules: terraform init
Re-attempt your terraform plan or apply and check if the issue still persists

Versions

Module version [Required]:

Terraform version:

Provider version(s):

Reproduction Code [Required]

Steps to reproduce the behavior:

Expected behavior

Actual behavior

Terminal Output Screenshot(s)

Additional context
It is similar to what is explained in https://stackoverflow.com/questions/62654684/terraform-alreadyexistsexception-an-alias-with-the-name-arnawskmsxxxxxxxxxx. Two hypotheses for this behaviour:

the state is in PENDING DELETION(not removed totally, but still exists with same name/path/arn)
the state file was not updated correctly (it might have been overwritten by an older version, it might for some reason have failed to be updated despite the correct applied changes from Terraform,...)

Try by including an alias like this but including a random number
creating an external KMS like this
An adding it into the cluster configuration block like this
Same KMS key can be used for https://github.com/cloudbees/terraform-aws-cloudbees-ci-eks-addon/issues/61

Try by including an alias like this but including a random number

When adding a random number it fails with:

I am deleting this issue it has not been longer reproduced for a long time


Add livenessProbe to trident-csi DaemonSet

Describe the solution you'd like
I want to add checking logic of trident-csi pod of daemonset after installing.
I rarely come across the below error after installing Trident.
$ kubectl describe pod test-pod
Events:
  Type     Reason                  Age                       From                                                   Message
  ----     ------                  ----                      ----                                                   -------
  ...
  Warning  FailedMount             2m21s (x1492 over 7m21s)  kubelet, test-03-worker-default-8982ccb9-bb4jn  MountVolume.MountDevice failed for volume "pvc-6f1bcde8-5820-4373-9d3c-047af02e1253" : rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial unix /var/lib/kubelet/plugins/csi.trident.netapp.io/csi.sock: connect: no such file or directory"

I know that the error can recover by re-creating the pod.
Therefore, I would like to recover it automatically.
A one idea is the adding livenessProbe  in a trident-csi daemonset.
So the livenessProbe try to check csi.sock.
Also the daemonset has initialDelaySeconds and periodSeconds for livenessProbe too.
Describe alternatives you've considered
none
Additional context
none

This was addressed in commit 503e040 and will be included in the Trident 21.04 release.


[question] JWT auth/localStorage:  what controls the global context ?

My question is in regards to fragments/ aggregation of fragments.
All of my fragments require get requests have an attached "global" jwt...
Is this handled by tailor? or is there something else (skipper?) that handles making sure that all http communication has correct headers/cookies set?
Also, is there a way for each fragment to access the global localStorage of the page in which the fragment is being loaded?

From my experience you can access the localStorage form the front end code in any fragment. If you are trying to pass data through to the fragments you will need to use the x-request-uri header in Tailor.

All of my fragments require get requests have an attached "global" jwt...

If it inside cookies or other request headers (that was set on client side) you can configure Tailor to pass JWT to upstream services.
Check parameter filterRequestHeader and default implementation here.

Also, is there a way for each fragment to access the global localStorage of the page in which the fragment is being loaded?

Yes, you can access global objects from any fragment if you want to share any data. Here is response from maintainer to similar question

If it inside cookies or other request headers (that was set on client side) you can configure Tailor to pass JWT to upstream services.
Check parameter filterRequestHeader and default implementation here.

let me give you an example, a user logs in, jwt injected in header, hits the home page, home page has calendar fragment and task fragment. calendar makes request for data without having to set jwt  as the homepage context includes auth: bearer token into header.

If calendar will request data only when it will be rendered in browser (on user interaction for example) then you don't need to care about Tailor, just call your backend API in a way that your prefer.  Simplest way will be if your backend will set Cookie with Set-Cookie: session=<JWT>, in that case every request from browser will be performed with this cookie (with some exceptions according to how cookie works) and you can get JWT in backend from cookie.
If you need JWT on step when Tailor resolve fragments (before page is actually loaded in browser), then again set it with Cookie, for example, and check parameter filterRequestHeader and default implementation here


[#fix] attempt to improve coverage in request and repo

Coverage remained the same at 98.496% when pulling 4abbf287155377a15b97dbd9aeb3e2955596cddf on flavio.fix.repo_coverage into 38f24eec69ba0df541ad8b6c825446ac5fd2c755 on master.


Save game

Complexity : mid
Task consists of next steps:

Implement interface to transform chess board state to FEN string.
Implement routine to save file. Note: each file should have unique ID that will be recognizable by user.
Implement command .game.save.
Extend interface of command .quit. Ask to save game.

After closing the issue, consider closing related task to list games and load a game

TAKEN

Done: https://github.com/Wandalen/game_chess/pull/87