feat(ingestion/dynamodb): implement pagination for list_tables

Also addressed an issue in handling the include_table_item config where the same table names in two different regions could clash. The fix is to specify the table name in the format of region.table_name in the config and also does the matching this way in the code.

@asikowitz @mayurinehate could one of you take a look at this?

@mayurinehate thank you for reviewing. I have addressed your feedback. Please take another look when you get a chance.

Thank you @mayurinehate for reviewing. @asikowitz could you merge it?

@asikowitz @anshbansal can we merge this now that the CI all seem to pass.
The frontend docker image failure doesn't seem to be related.


Error While Creating DataBase

Hi,
I am starting to look into the code so I have cloned the site but I have this error

Hi @nazimboudeffa  have you dragged and dropped the database.sql file to create database?

@nazimboudeffa  if now the code is working fine please close the issue.

@nazimboudeffa why are you waiting for? I have already updated the file.

Oh nice, it is waying 7 hours ago, go to try the actual one :)

I think there were some problem but now you can check.


Fix: #707 'Problems with entities/styles' issue.

Reference Issue

Fixes #707
Ref. #651
What does this implement/fix? Explain your changes.

Any other comments?

I fixed these issues, but I think that SvgNodeReader and SvgTextReader should be obsoleted.
These inherited classes have side effects and cause issues like this one.
These classes are needed for SvgDocument class Open method with entities.
But I don't think it's necessary because # 651 didn't work until it was resolved, and Open(XmlDocument document, , Dictionary<string, string> entities) doesn't exist.


Add support for variable renaming

If you really want to "be the best JavaScript code formatter" (and I want you to become it because I need this tool !!), esformatter should definitely support renaming variable in some form. To understand what I mean you have to check out this online but closed-source JavaScript formatter: http://www.jsnice.org.
There are two things involved in this tool:

renaming local variable (based on some sort of neural network  I guess, or any kind of memory, artificial intelligence or whatever)
interactive variable renaming, which allow you to rename a variable in the formatted code

I don't know if esformatter could support this second point in any form but if yes it would be really, really powerful :)

another plugin: https://github.com/twolfson/esformatter-phonetic


Update trainer.py

Remove ‘import StringIO’ . because this module is not used in trainer.py script and it will make an error when using python3.6.

Fixed in #37


Precompiled Contracts on the host env

What problem does your feature solve?
Is there yet any thought on precompiled contracts? For example, elliptic curve pairings or elliptic curve multiplication/addition are inefficient or difficult to implement on the EVM, so Ethereum directly implements the contract in Go (https://github.com/ethereum/go-ethereum/blob/master/core/vm/contracts.go#L504), which is also more safe and efficient since it can directly rely on existing and optimized implementations like bn256 (https://pkg.go.dev/golang.org/x/crypto/bn256).
What would you like to see?
Allowing for some contract functions to be pre-compiled into the network and can be called by a contract, for example in solidity I can call the following code to perform BN256 pairing by calling this go function: https://github.com/ethereum/go-ethereum/blob/master/core/vm/contracts.go#L504
assembly {
            success := staticcall(sub(gas(), 2000), 8, add(input, 0x20), mul(inputSize, 0x20), out, 0x20)
            // Use "invalid" to make gas estimation work
            switch success case 0 { invalid() }
        }

Is this something that is somewhat compatible with Soroban’s host environment?

@leighmcculloch Does this mean that the token contract has a different execution VM and can use external crates for example while running on the host environment?

cc @graydon @jonjove

@heytdep there are two different things here with somewhat different semantics.

Simple host functions, which are probably the best bet for things like elliptic curve operations. These are compiled to native code, can use any rust libraries we're comfortable adding to the host, and can be very cheaply called from any contract. We already provide a bunch of host functions and will definitely be providing more (especially cryptographic ones) over time. The whole design of Soroban rests heavily on having a large repertoire of useful host functions.
Full built-in contracts which have some larger quantity of the machinery that a wasm contract would have (eg. an identifier that can serve as the target of the call operation, conformance to a standard interface such as that for tokens) but are still compiled to native code and linked into the host. We're providing some of these, but they're a less-general tool, and involve a bit more machinery than a simple function.

@graydon that sounds like an optimal design. I was already implementing EC operations with soroban types but given that we'll have more optimized host functions I guess I'll stop 😅.
Thanks for the clarification, happy to give any insight on EC ops crates when its time to start extending the host functions.


Animations

Hello,
Thanks for the library. I used it in my app it was very easy to setup and use it.
Do you consider to add support for animations? That would be nice to fill stars animatable.
Thanks!

Hi, thanks for kind words and the idea. I've never thought of that. Could you describe how the animation would work from the user perspective? :)

Closing the issue, feel free to reopen when needed.


Cannot get it working in Unraid Docker

Error log on unraid shows this:

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/volvoAAOS2mqtt/./main.py", line 2, in <module>
    from volvo import authorize
  File "/volvoAAOS2mqtt/volvo.py", line 3, in <module>
    import mqtt
  File "/volvoAAOS2mqtt/mqtt.py", line 6, in <module>
    import util
  File "/volvoAAOS2mqtt/util.py", line 9, in <module>
    from const import units
  File "/volvoAAOS2mqtt/const.py", line 93, in <module>
    {"name": "Electric Range", "domain": "sensor", "id": "electric_range", "unit": LENGTH_KILOMETERS if not units.get(settings["babelLocale"]) else units[settings["babelLocale"]]["electric_range"]["unit"], "icon": "map-marker-distance", "url": RECHARGE_STATE_URL, "state_class": "measurement"},
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/functional.py", line 18, in inner
    self._setup()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 174, in _setup
    self._wrapped = Settings(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 253, in __init__
    self.execute_loaders()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 1035, in execute_loaders
    core_loader.load(self, env, silent=silent, key=key)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 33, in load
    load_from_env(obj, global_prefix, key, silent, IDENTIFIER + "_global")
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 73, in load_from_env
    data = {
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 74, in <dictcomp>
    key[trim_len:]: parse_conf_data(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 379, in parse_conf_data
    return _parse_conf_data(data, tomlfy=tomlfy, box_settings=box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 343, in _parse_conf_data
    value = get_converter(converter_key, value, box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 275, in get_converter
    converted_value = converter(value)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 250, in <lambda>
    else json.loads(value),
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 70 (char 69)
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 273, in get_converter
    converted_value = converter(value, box_settings=box_settings)
TypeError: <lambda>() got an unexpected keyword argument 'box_settings'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/volvoAAOS2mqtt/./main.py", line 2, in <module>
    from volvo import authorize
  File "/volvoAAOS2mqtt/volvo.py", line 3, in <module>
    import mqtt
  File "/volvoAAOS2mqtt/mqtt.py", line 6, in <module>
    import util
  File "/volvoAAOS2mqtt/util.py", line 9, in <module>
    from const import units
  File "/volvoAAOS2mqtt/const.py", line 93, in <module>
    {"name": "Electric Range", "domain": "sensor", "id": "electric_range", "unit": LENGTH_KILOMETERS if not units.get(settings["babelLocale"]) else units[settings["babelLocale"]]["electric_range"]["unit"], "icon": "map-marker-distance", "url": RECHARGE_STATE_URL, "state_class": "measurement"},
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/functional.py", line 18, in inner
    self._setup()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 174, in _setup
    self._wrapped = Settings(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 253, in __init__
    self.execute_loaders()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 1035, in execute_loaders
    core_loader.load(self, env, silent=silent, key=key)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 33, in load
    load_from_env(obj, global_prefix, key, silent, IDENTIFIER + "_global")
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 73, in load_from_env
    data = {
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 74, in <dictcomp>
    key[trim_len:]: parse_conf_data(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 379, in parse_conf_data
    return _parse_conf_data(data, tomlfy=tomlfy, box_settings=box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 343, in _parse_conf_data
    value = get_converter(converter_key, value, box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 275, in get_converter
    converted_value = converter(value)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 250, in <lambda>
    else json.loads(value),
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 70 (char 69)

** Press ANY KEY to close this window ** ```

Thats putting all this info here into extra parameters and replacing with my correct details:
-e CONF_updateInterval=300 -e CONF_babelLocale='de' -e CONF_mqtt='@json {"broker": "", "username": "", "password": "", "port": 1883}' -e CONF_volvoData='@json {"username": "", "password": "", "vin": "", "vccapikey": ["key1", "key2"], "odometerMultiplier": 1, "averageSpeedDivider": 1, "averageFuelConsumptionMultiplier": 1}' -e TZ='Europe/Berlin'

also will not start if using variables like this, it says invalid host

I'm not having any experience with unraid, so I can't help you, sorry.

I have tried with ' before and after the variables, tried with '@json{variable}'  too. Usually you'd add the variable as per the image.

It formats the docker template like so when adding that variables. which to me reads okay..

yet it will not start the docker container and gives these errors in the log
text  error  warn  system  array  login

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 273, in get_converter
    converted_value = converter(value, box_settings=box_settings)
TypeError: <lambda>() got an unexpected keyword argument 'box_settings'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/volvoAAOS2mqtt/./main.py", line 2, in <module>
    from volvo import authorize
  File "/volvoAAOS2mqtt/volvo.py", line 3, in <module>
    import mqtt
  File "/volvoAAOS2mqtt/mqtt.py", line 6, in <module>
    import util
  File "/volvoAAOS2mqtt/util.py", line 9, in <module>
    from const import units
  File "/volvoAAOS2mqtt/const.py", line 93, in <module>
    {"name": "Electric Range", "domain": "sensor", "id": "electric_range", "unit": LENGTH_KILOMETERS if not units.get(settings["babelLocale"]) else units[settings["babelLocale"]]["electric_range"]["unit"], "icon": "map-marker-distance", "url": RECHARGE_STATE_URL, "state_class": "measurement"},
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/functional.py", line 18, in inner
    self._setup()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 174, in _setup
    self._wrapped = Settings(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 253, in __init__
    self.execute_loaders()
  File "/usr/local/lib/python3.9/site-packages/dynaconf/base.py", line 1035, in execute_loaders
    core_loader.load(self, env, silent=silent, key=key)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 33, in load
    load_from_env(obj, global_prefix, key, silent, IDENTIFIER + "_global")
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 73, in load_from_env
    data = {
  File "/usr/local/lib/python3.9/site-packages/dynaconf/loaders/env_loader.py", line 74, in <dictcomp>
    key[trim_len:]: parse_conf_data(
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 379, in parse_conf_data
    return _parse_conf_data(data, tomlfy=tomlfy, box_settings=box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 343, in _parse_conf_data
    value = get_converter(converter_key, value, box_settings)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 275, in get_converter
    converted_value = converter(value)
  File "/usr/local/lib/python3.9/site-packages/dynaconf/utils/parse_conf.py", line 250, in <lambda>
    else json.loads(value),
  File "/usr/local/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.9/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 1 column 70 (char 69)

** Press ANY KEY to close this window **

Do i need to publish the application
No
Sometimes it takes some time before the API-key starts to work.

Okay, I will wait an hour and see if working.
Will entities be created from the mqtt messages inside of home assistant or do i need to create these myself?

do i need to create these myself?
No, if everything is working, entities will be created by Home Assistant.

1705658619: Client<EMAIL_ADDRESS>closed its connection.

This seems to be a local issue. Are you using the ha addon ?

This seems to be a local issue. Are you using the ha addon ?

I'm on unraid, ha core container, mosquito container and volvo2mqtt container. It'd pulling entities in now, but all 'unknown'

The controls do not work and haven't updated in 14 hours..

Please enable debug an show me some logs.

Please enable debug an show me some logs.

text  error  warn  system  array  login

Traceback (most recent call last):
  File "/volvoAAOS2mqtt/./main.py", line 16, in <module>
    update_loop()
  File "/volvoAAOS2mqtt/mqtt.py", line 215, in update_loop
    create_ha_devices()
  File "/volvoAAOS2mqtt/mqtt.py", line 326, in create_ha_devices
    device = volvo.get_vehicle_details(vin)
  File "/volvoAAOS2mqtt/volvo.py", line 235, in get_vehicle_details
    raise Exception("Getting vehicle details failed. Status Code: " + str(response.status_code) +
Exception: Getting vehicle details failed. Status Code: 401. Error: {
                        "status": 401,
                        "error": {
                            "message": "Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application."
                        }
                    }
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "washerFluidLevelWarning" : {
      "value" : "NO_WARNING",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "timeToService" : {
      "value" : 2,
      "unit" : "months",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    }
  }
}
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Success! Distance to Service is supported by your vehicle.
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Starting GET call against https://api.volvocars.com/connected-vehicle/v2/vehicles/{0}/diagnostics
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Response status code: 401
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: {
                        "status": 401,
                        "error": {
                            "message": "Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application."
                        }
                    }
Jan 19 21:44:15 volvo2mqtt [1] - ERROR: API Call failed. Status Code: 401. Error: {
                        "status": 401,
                        "error": {
                            "message": "Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application."
                        }
                    }
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Failed, Time to Service is unfortunately not supported by your vehicle.
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Starting GET call against https://api.volvocars.com/connected-vehicle/v2/vehicles/{0}/diagnostics
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Response status code: 401
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: {
                        "status": 401,
                        "error": {
                            "message": "Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application."
                        }
                    }
Jan 19 21:44:15 volvo2mqtt [1] - ERROR: API Call failed. Status Code: 401. Error: {
                        "status": 401,
                        "error": {
                            "message": "Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application."
                        }
                    }
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Failed, Service warning status is unfortunately not supported by your vehicle.
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Starting GET call against https://api.volvocars.com/connected-vehicle/v2/vehicles/{0}/diagnostics
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: Response status code: 200
Jan 19 21:44:15 volvo2mqtt [1] - DEBUG: {
  "data" : {
    "serviceWarning" : {
      "value" : "NO_WARNING",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "engineHoursToService" : {
      "value" : 381,
      "unit" : "h",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "distanceToService" : {
      "value" : 18076,
      "unit" : "km",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "washerFluidLevelWarning" : {
      "value" : "NO_WARNING",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    },
    "timeToService" : {
      "value" : 2,
      "unit" : "months",
      "timestamp" : "2024-01-19T11:47:08.449Z"
    }
  }
}
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Success! Washer Fluid Level warning is supported by your vehicle.
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Success! API Backend status is supported by your vehicle.

Copying API keys directly from here. Formatted like this in docker:

Log after restarting container. ( I will regen API key after posting this )
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Success! Washer Fluid Level warning is supported by your vehicle.
Jan 19 21:44:15 volvo2mqtt [1] - INFO: Success! API Backend status is supported by your vehicle.
Jan 20 08:19:37 volvo2mqtt [1] - INFO: Starting volvo2mqtt version v1.8.23
Jan 20 08:19:37 volvo2mqtt [1] - WARNING: VCCAPIKEY dc2a20b2915847e1ac8f0c3dc10bfc62 isn't working! Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application.
Jan 20 08:19:37 volvo2mqtt [1] - WARNING: VCCAPIKEY 10eba83e646d4fe689b6fd50fbb99df1 isn't working! Access denied due to invalid VCC-API-KEY. Make sure to provide a valid key for an active application.
Jan 20 08:19:37 volvo2mqtt [1] - DEBUG: [{'key': 'dc2a20b2915847e1ac8f0c3dc10bfc62', 'extended': True, 'extended_until': None, 'in_use': False}, {'key': '10eba83e646d4fe689b6fd50fbb99df1', 'extended': True, 'extended_until': None, 'in_use': False}]
Jan 20 08:19:37 volvo2mqtt [1] - WARNING: No working VCCAPIKEY found, waiting 10 minutes. Then trying again!

Your vcc API key isn't working. This is not a volvo2mqtt issue.
PS: You only need the primary key, not the secondary.

Your vcc API key isn't working. This is not a volvo2mqtt issue.
PS: You only need the primary key, not the secondary.

Okay ill keep trying, the API key as you can see though is copy and pasted and correct with what is issued by volvo

Just wait, it will work!

Just wait, it will work!

Fingers crossed, id have thought it wouldnt take days though


DefaultAzureCredential Azure SQL error: VisualStudioCodeCredential The refresh token has expired due to inactivity

Package Name: azure-identity
Package Version: 1.8.0
Operating System: Windows
Python Version: 3.9.7

Describe the bug
Using DefaultAzureCredential from azure.identity while get_token() gives the following error for certain users:
VisualStudioCodeCredential The refresh token has expired due to inactivity
To Reproduce
Using the following code: https://docs.sqlalchemy.org/en/14/dialects/mssql.html#connecting-to-databases-with-access-tokens
On this line:
raw_token = azure_credentials.get_token(TOKEN_URL).token.encode("utf-16-le")

the error is thrown that the refresh token has expired due to inactivity of greater than 90 days. The code works fine for me, but not for my coworkers. We've tried updating all packages and dropping the users from Azure SQL and recreating them. I found this in the documentation (https://docs.microsoft.com/en-us/cli/azure/authenticate-azure-cli) saying

As of August 2018 this token is revoked after 90 days of inactivity, but this value can be changed by Microsoft or your tenant administrator. Once the token is revoked you get a message from the CLI saying you need to login again.

However, I can't find anywhere in the Azure Portal to renew the token. Also, using DefaultAzureCredential works fine for connecting to blob storage, the error only throws on get_token() on the database.

Hi @blawrence-datadx , thanks for the feedback. We'll take a look at this and get back to you asap.

Thanks for reaching out.
Did you have a chance to login in VS code again?
You can find the information in https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/identity/azure-identity/TROUBLESHOOTING.md#troubleshooting-visual-studio-code-authentication-issues.

Hi @xiangyan99. Yes, we're using the Azure Account extension and have tried logging out and logging back in and have also tried completely reinstalling VS Code.

Hi @xiangyan99. Yes, we're using the Azure Account extension and have tried logging out and logging back in and have also tried completely reinstalling VS Code.

@blawrence-datadx Thanks for the information. Could you to check the version of the Azure Account extension?
There is a known issue that azure-identity library does not work well with the latest version of Azure Account extension.
You can get more information in https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/identity/azure-identity/README.md#authenticate-during-local-development

@xiangyan99 we are all using v0.10.1. It works fine for me, but the refresh token error happens for my two colleagues

If you don't mind, could you share how you use the code snippets?
v0.10.1 was confirmed to not work.

Yes, the code is the same as the SQLAlchemy example:
import struct
from sqlalchemy import create_engine, event
from sqlalchemy.engine.url import URL
from azure import identity

SQL_COPT_SS_ACCESS_TOKEN = 1256  # Connection option for access tokens, as defined in msodbcsql.h
TOKEN_URL = "https://database.windows.net/"  # The token URL for any Azure SQL database

connection_string = "mssql+pyodbc://@my-server.database.windows.net/myDb?driver=ODBC+Driver+17+for+SQL+Server"

engine = create_engine(connection_string)

azure_credentials = identity.DefaultAzureCredential()

@event.listens_for(engine, "do_connect")
def provide_token(dialect, conn_rec, cargs, cparams):
    # remove the "Trusted_Connection" parameter that SQLAlchemy adds
    cargs[0] = cargs[0].replace(";Trusted_Connection=Yes", "")

    # create token credential
    raw_token = azure_credentials.get_token(TOKEN_URL).token.encode("utf-16-le")
    token_struct = struct.pack(f"<I{len(raw_token)}s", len(raw_token), raw_token)

    # apply it to keyword arguments
    cparams["attrs_before"] = {SQL_COPT_SS_ACCESS_TOKEN: token_struct}

connection = engine.connect()
query = 'select * from table'
# error happens here for my colleagues, but works fine for me
results = connection.execute(query)

That works fine for me, but my colleague gets this error:
Azure Active Directory error '(invalid_grant) AADSTS700082: The refresh token has expired due to inactivity. The token was issued on 2021-12-06T17:37:42.4470674Z and was inactive for 90.00:00:00.

Thanks for the information.
Here is my guess:
After you upgraded your azure account extension, it was no longer able to update the refresh token.
The last time your colleagues used earlier version of Azure Account extension to get the token was on 2021-12-06.
To validate it, could you ask your colleagues to downgrade Azure Account extension and try login again?
Thanks.

That worked! Thanks so much @xiangyan99

Asking to install an old version is not a solution for this problem in my opinion.
Could you please reopen this issue and keep it open until the root cause is solved?
#please-reopen

@hansmbakker We have https://github.com/Azure/azure-sdk-for-python/issues/23685 to track the work.

thank you!

Step-by-Step for anyone else running into this:

Downgrade Azure Account extension to v0.9.11
Replace DefaultAzureCredential with VisualStudioCodeCredential
Run a code path that would've used the VisualStudioCodeCredential. This will refresh the expired token
Revert change such that VisualStudioCodeCredential is now back to DefaultAzureCredential
Update Azure Account extension to the latest available version
Run a code path that uses the DefaultAzureCredential. Observe it working


404 on https://pecl.php.net/rest/r/mysql/5.3.29.xml (and others)

When trying to phpbrew ext install mysql I found out phpbrew fails to download https://pecl.php.net/rest/r/mysql/5.3.29.xml and therefor fails to build the mysql extension with the error Exception: Invalid package version: mysql @
I've also tried adding a different version number, like 5.3.23 or 5.4.45 or stable, but those 404 too.
In simular fashion, phpbrew ext known mysql fails because http://pecl.php.net/rest/r/mysql/allreleases.xml returns a 404.
Is this a temporary problem? Is there any way I can work around this?
It appears this problem doesn't occur for the extensions mysqli, pdo_mysql and pdo_sqlite.

I think you're missing php source code on your file system. did you install any php via phpbrew? please make sure you've selected one php from the list.

I did compile/install a version using phpbrew:
export PHPBREW_ROOT=/opt/phpbrew

phpbrew install 5.3.29 \
+default +dba +ipv6 +wddx +ftp +hash +exif +cgi +soap +session +imap \
+tidy +xmlrpc +zlib +gettext +iconv -- \
--with-gd \
--with-config-file-path=/etc/php5.3/cgi \
--with-config-file-scan-dir=/etc/php5.3/cgi/conf.d \
--with-mysql-sock=/var/run/mysqld/mysqld.sock

phpbrew use 5.3.29

phpbrew ext install imagick
phpbrew ext install apc
phpbrew ext install pspell
phpbrew ext install imap -- --with-imap-ssl --with-kerberos

This all compiles beautifully and I can use it without problems.
The directory /opt/phpbrew/build/php-5.3.29/ext/mysql has these files:
-rw-r--r-- 1  4676 config.m4
-rw-r--r-- 1   926 config.w32
-rw-r--r-- 1    46 CREDITS
-rw-r--r-- 1  8617 mysql.dsp
-rw-r--r-- 1  4438 mysql.mak
-rw-r--r-- 1  1505 mysql_mysqlnd.h
-rw-r--r-- 1  1904 package.xml
-rw-r--r-- 1 76666 php_mysql.c
-rw-r--r-- 1  1420 php_mysql.h
-rw-r--r-- 1  4078 php_mysql_structs.h
drwxr-xr-x 2  4096 tests

So I at least have some source code. It may be incomplete, but I've got no reasons to believe it is. Could you elaborate on why you think I'm missing source code? How would this lead to a 404 from https://pecl.php.net ? The URL https://pecl.php.net/rest/r/mysql/5.3.29.xml also returns 404 from my workstation (which is a different machine than I use to build php).
Note that mysql is only an example since the problem also occurs on other extensions. A couple are mentioned in my first post.

When you run the extension installer, it will first check if the extension source exists in your build directory (by your current php version environment variable). If not, it will fallback to the pecl installer, however there is no such mysql extension on pecl site, therefore it gives you 404 error.

How can I check if all the needed source code exists in my build directory? I've already posted the contents of the /ext/mysql directory and it seems to be in good order. What causes phpbrew to think it's not complete?

@martijntraa I'm having the same issue. Did you find a solution for this?

@federivo I never found a way to install MySQL as a seperate extension.
Instead, I solved my particular problem by including it in the build with +mysql like so:
phpbrew install 5.3.29 \
+default +mysql +pdo +sqlite \
[... other options ...]
and by making adjustments on other parts of my system to match up.
I'm having trouble remembering what exact reason I had to prefer MySQL as an extension. What is your reason? Perhaps I'll remember when someone jogs my memory.

I installed without the +mysql variant (just forgot to add it) and tried to install it as separated, no other reason than that. I guess my solution is to reinstall with the variant (just like you did). But it would be nice to understand what the problem was.
Thank you for the quick response!


add upgrade survey to 112

@therealmitchconnors: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

release-notes_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test release-notes_istio_release-1.12

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@therealmitchconnors: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

release-notes_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test release-notes_istio_release-1.12

lint_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test lint_istio_release-1.12

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@therealmitchconnors: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

release-notes_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test release-notes_istio_release-1.12

lint_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test lint_istio_release-1.12

gencheck_istio_release-1.12
a56ea41783c521dc0758245022b7c0bfd9c8f65e
link
true
/test gencheck_istio_release-1.12

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


Apply syntax highlighting to README example

This applies the ruby language identifier to a code block in the README
that previously did not specify a language to use for syntax
highlighting.

thank you!


Feature/code analysis

Changes Unknown when pulling e29f8a72ba91c73cc0f99a20dc04cafe825c2c82 on feature/code-analysis into ** on master**.


Shared credentials file support

Supports user specified credentials file location for terragrunt-specific calls to object store. Formatted and all tests passing.
You will want to review this after merging https://github.com/gruntwork-io/terragrunt/pull/567, but all changes in 07c1db3 here, regardless.

@brikis98 Ready for review. All tests passing.

@brikis98 Thx.

@brikis98 BTW, how long does it typically take you to get around updating brew with the new release?

The community actually does all the homebrew updating for us! See https://github.com/gruntwork-io/terragrunt/issues/551.

Done https://github.com/Homebrew/homebrew-core/pull/32124

Nice, thank you!


node & angular showcase project

[x] node showcase project using glitch
[x]  angular showcase project using stackblitz (also use pagedLoader to display data)

we are not gonna implement the angular showcase for now

@damianesteban we published a node sample on stackblitz, check it out https://stackblitz.com/edit/dynamo-easy-node-sample


Insecure Deserialization due to insecure TypeNameHandling leads to Code Execution.

Expected Behavior
The application should not deserialize untrusted data which is user controllable without proper checks and validation of incoming types.
Actual Behavior

While deserializing a string, the deserializer is able to invoke unsafe classes that can execute OS commands due to insecure configuration of TypeNameHandling property in JsonSerializerSettings, which is currently set to All from version <IP_ADDRESS> to <IP_ADDRESS>. The vulnerable code is in Common/Data/BaseData.cs line 343.
Potential Solution

While deserializing untrusted data. DO NOT use any TypeNameHandling other than None. (Highly Recommended)
If TypeNameHandling other than None is required, then use a SerializationBinder to validate and whitelist the incoming types.

Reproducing the Problem

After opening the solution in visual studio, write the below lines of code in any class that inherits from BaseData class. I have written below code in BasicTemplateAlgorithm.cs.

// string containing exploit code. The string source can be data from remote data server or local file.
string server_data = "{"$type":"System.Windows.Data.ObjectDataProvider,PresentationFramework","MethodName":"Start","MethodParameters":{"$type":"System.Collections.ArrayList,mscorlib","$values":["calc"]},"ObjectInstance":{"$type":"System.Diagnostics.Process,System"}}";
// Call the DeserializeMessage method in BaseData by passing string, which will try to deserialize the string to an object.
object obj = BaseData.DeserializeMessage(server_data);

Rebuild and run the solution. The calculator program will pop up. I have a video POC. Please request in case required

System Information
Tested on Windows 10 with Visual Studio 2019 Community Edition. Codebase version tested <IP_ADDRESS>.
Checklist

[x] I have completely filled out this template
[x] I have confirmed that this issue exists on the current master branch
[x] I have confirmed that this is not a duplicate issue by searching issues

[x] I have provided detailed steps to reproduce the issue

Hi, this issue was assigned with CVE-2020-20136.
Was this issue ever addressed?
thanks in advance!

Closing this issue for now since Lean is expected to be running in an environment where the data provided is trusted


Change instance variables for local variables

@jarodreyes for the same reasons given at #4 I changed the unneeded instance variables. As part of this refactoring, I added a couple of test to made the changes confidently.
Would you mind having a look on this one please?

Awesome!


UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf0 in position 57: invalid continuation byte

ERROR    -  Encoding error reading file: en\licence\index.md
ERROR    -  Error reading page 'en\licence\index.md': 'utf-8' codec can't decode byte 0xf0 in position 57: invalid
continuation byte
ERROR    -  Error reading page 'licence.md': 'utf-8' codec can't decode byte 0xf0 in position 57: invalid continuation
byte
Traceback (most recent call last):
File "C:\Program Files\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Program Files\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Program Files\Python310\Scripts\mkdocs.exe_main.py", line 7, in
File "C:\Program Files\Python310\lib\site-packages\click\core.py", line 1128, in call
return self.main(*args, **kwargs)
File "C:\Program Files\Python310\lib\site-packages\click\core.py", line 1053, in main
rv = self.invoke(ctx)
File "C:\Program Files\Python310\lib\site-packages\click\core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Program Files\Python310\lib\site-packages\click\core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Program Files\Python310\lib\site-packages\click\core.py", line 754, in invoke
return _callback(*args, **kwargs)
File "C:\Program Files\Python310\lib\site-packages\mkdocs_main.py", line 177, in serve_command
serve.serve(dev_addr=dev_addr, livereload=livereload, **kwargs)
File "C:\Program Files\Python310\lib\site-packages\mkdocs\commands\serve.py", line 54, in serve
config = builder()
File "C:\Program Files\Python310\lib\site-packages\mkdocs\commands\serve.py", line 49, in builder
build(config, live_server=live_server, dirty=dirty)
File "C:\Program Files\Python310\lib\site-packages\mkdocs\commands\build.py", line 292, in build
_populate_page(file.page, config, files, dirty)
File "C:\Program Files\Python310\lib\site-packages\mkdocs\commands\build.py", line 170, in _populate_page
page.markdown = config['plugins'].run_event(
File "C:\Program Files\Python310\lib\site-packages\mkdocs\plugins.py", line 102, in run_event
result = method(item, **kwargs)
File "C:\Program Files\Python310\lib\site-packages\mkdocs_mdpo_plugin\plugin.py", line 359, in on_page_markdown
mkdocs.commands.build._populate_page(
File "C:\Program Files\Python310\lib\site-packages\mkdocs\commands\build.py", line 167, in _populate_page
page.read_source(config)
File "C:\Program Files\Python310\lib\site-packages\mkdocs\structure\pages.py", line 120, in read_source
source = f.read()
File "C:\Program Files\Python310\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
File "C:\Program Files\Python310\lib\encodings\utf_8_sig.py", line 69, in _buffer_decode
return codecs.utf_8_decode(input, errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf0 in position 57: invalid continuation byte

Seems a problem with Mkdocs in this line, but maybe not, I'm not sure without more info about it. Could you check if the error happens without the plugin installed? Also, I need:

Mkdocs version.
mkdocs-mdpo-plugin version
mdpo version (md2po --version)
The file for which the reading is failing.

I think the faster solution is to share the repository with you. If you can enable the plugin for the following repository (these are my course notes) then you can also debug on your site easily. Thanks for your work.
https://github.com/ucoruh/ce100-algorithms-and-programming-II

Sorry, but I'm not going to do your work. In fact, I don't understand the repository that you've provided and I'm not going to loss my time studying it. If you are interested in resolving the issue share the data that has been requested.


Use numba==0.37 and llvmlite==0.22.0 (on master)

Same as #14 but directly applied to master. Let's check if #11 introduces a bug.

So, Travis is happy: https://travis-ci.org/JuliaDiffEq/diffeqpy/builds/370950852
Strange....


Add a notification when OATH storage is full

I have a YubiKey NEO (FW 3.4.9) and I'm attempting to add another OTP credential to it with Yubico Authenticator (4.0.1, Windows 10 1703 x64). I scan the QR code with the reader, hit Add Credential and nothing happens; no message and the credential isn't added. Attempting to do the same with the Android app gives me a "YubiKey OATH storage is full!" message. I think the desktop app should have the same warning instead of silently backing out.

Agreed, should be added.

It would also be useful to have some visible metric showing the utilization of the OATH storage (e.g. in bytes perhaps) -- but I see that's not in the existing Yubikey OATH CCID protocol. :disappointed:


[base-ui][joy-ui] Hover styles persist after clicking on an element on mobile

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example:
Steps:

Open https://mui.com/joy-ui/react-button/
Click on an element that has a &:hover style

Current behavior 😯
KO, Joy UI
https://user-images.githubusercontent.com/3165635/226317657-b2c01f26-7727-4306-9bfc-4a616d1e1e25.mov
KO, Base UI
https://user-images.githubusercontent.com/3165635/226316275-3ef8f658-87b9-4487-8f54-a6b66e1624d5.mov
Expected behavior 🤔
OK on Material UI, however there is a limit, it's broken on all Samsung phones: https://github.com/mui/material-ui/issues/15000#issuecomment-504754518
https://user-images.githubusercontent.com/3165635/226316269-20557aa8-c234-4680-a038-5b0695d205c1.mov
Context 🔦
https://github.com/mui/material-ui/issues/15000
Your environment 🌎
MUI Core v5.11.13

@danilo-leal @siriwatknp does this expected UX makes sense? It's based on how native apps behave. On the web, it's very common for websites to leave an artifact hover style after an interaction, my thought was that native apps usually set the tone for what a great UX is, so I thought that we should probably copy it.

I'm not 100% sure if you're asking if there should be a hover state on mobile but that's what I'm understanding 😬 Well, I guess hover technically "doesn't exist" on mobile as you can't just hover something, you either touch something or not. However, just quickly checked 3 very high-quality apps here, all native as far as I know, and they all react to a long-press interaction, which is sort of, to me, in between the hover and active states. So, in the end, yeah, they should probably react somehow and not be purely static.
Airbnb
https://user-images.githubusercontent.com/67129314/226446531-e5ade186-7eb7-4ef4-8b2f-63866c6b8015.mp4
GitHub
https://user-images.githubusercontent.com/67129314/226446557-04fac0bb-4d7d-4ceb-b7ee-a417647f871a.mp4
Uber
https://user-images.githubusercontent.com/67129314/226446572-2d2db1a3-f4cf-47fe-9f7f-056c1f322b8c.mp4

Right, to be clear, my concern is with the UI state that persists after the interaction. I have to touch on a dead area to remove it.

Ah, I see. Agree with you ⎯ it looks correct to me not to persist the state post-touch, which would be equivalent to not persisting the state post-click. In other words, the hover/active-like style difference would be triggered while you're actively touching and be gone the moment you lift the touch interaction up. 👍

@oliviertassinari I would like to pick this up

I'm reopening, the issue is still present on Base UI: https://mui.com/base/react-button/

@oliviertassinari I'll be pushing a fix for this shortly. Sorry for not catching this.

@gitstart no problem.
Note that it's not specific to the button, this bug can be reproduced on many other pages of the docs. The first one I tried reproduced: https://mui.com/joy-ui/react-checkbox/.

More context on the issue, faced in MUI X too https://github.com/mui/mui-x/issues/10039#issuecomment-1690755359


Introduction to ember-islands lightning talk at a future Global Ember Meetup

Would you be open to giving an Introduction to ember-islands talk about a future Global Ember Meetup?
The talk is usually 15 minutes long and answers the following questions:

What problem is the addon trying to solve?
How to get started?
How should it be used?
What should person be aware of?

We'll produce a video that you can link to in your README. You can see existing videos here https://vimeo.com/album/3607049
What do you think?

Hey Taras,
Not sure if you remember but we met very briefly at a breakfast spot at
last EmberConf. I really like what you've been doing with the Global Meetup.
Yes! I would like to give a talk. Those questions are a good start, and
there is actually some pretty interesting stuff with the Ember public
visit API (probably coming in 2.3) that will make the next version of
this addon much simpler and allow for some interesting new features.
I looked around for the next date, but didn't see anything right away. Let
me know the date/time and any other logistics.
On Tue, Oct 13, 2015 at 9:00 AM, Taras Mankovski<EMAIL_ADDRESS>wrote:

Would you be open to giving an Introduction to ember-islands talk about a
future Global Ember Meetup?
The talk is usually 15 minutes long and answers the following questions:

What problem is the addon trying to solve?
How to get started?
How should it be used?
What should person be aware of?

We'll produce a video that you can link to in your README. You can see
existing videos here https://vimeo.com/album/3607049
What do you think?
—
Reply to this email directly or view it on GitHub
https://github.com/mitchlloyd/ember-islands/issues/11.

That’s awesome and thank you for the kind world. The community’s openness to contributing is what makes it awesome.
I hear you about Ember 2.3 visit API. Would you prefer to hold off the recoding until then?
--
Taras Mankovski
On October 13, 2015 at 12:13:55 PM, Mitch Lloyd<EMAIL_ADDRESS>wrote:
Hey Taras,
Not sure if you remember but we met very briefly at a breakfast spot at
last EmberConf. I really like what you've been doing with the Global Meetup.
Yes! I would like to give a talk. Those questions are a good start, and
there is actually some pretty interesting stuff with the Ember public
visit API (probably coming in 2.3) that will make the next version of
this addon much simpler and allow for some interesting new features.
I looked around for the next date, but didn't see anything right away. Let
me know the date/time and any other logistics.
On Tue, Oct 13, 2015 at 9:00 AM, Taras Mankovski<EMAIL_ADDRESS>wrote:

Would you be open to giving an Introduction to ember-islands talk about a
future Global Ember Meetup?
The talk is usually 15 minutes long and answers the following questions:

What problem is the addon trying to solve?
How to get started?
How should it be used?
What should person be aware of?

We'll produce a video that you can link to in your README. You can see
existing videos here https://vimeo.com/album/3607049
What do you think?
—
Reply to this email directly or view it on GitHub
https://github.com/mitchlloyd/ember-islands/issues/11.

—
Reply to this email directly or view it on GitHub.

@taras I've got the next version of Ember Islands finalized (as far as I know right now). I'll be waiting on the Ember 2.3 release for 1.0 so any time near the end of December or later would work great. Could you fit me in around that time?

I'm thinking sometime in January. What do you think?

That would be great.

@mitchlloyd how does January 16th or January 30th sound?

16th would probably be a little better, but both would work.

16th it is :) Consider it booked. Look forward to it!


Non-invertible covariance matrix during regression optimization

When I attempt to perform GP regression on a dataset where dim(X)=17 and dim(y)=1, I get an exception as follows after about 40 iterations of the L-BFGS-B solver:
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 655, in _do_call
    return fn(*args)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 637, in _run_fn
    status, run_metadata)
  File "/usr/lib/python3.5/contextlib.py", line 66, in __exit__
    next(self.gen)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors.py", line 450, in raise_exception_on_not_ok_status
    pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors.InvalidArgumentError: Input matrix is not invertible.
     [[Node: MatrixTriangularSolve = MatrixTriangularSolve[T=DT_DOUBLE, adjoint=false, lower=true, _device="/job:localhost/replica:0/task:0/cpu:0"](Cholesky, sub_1)]]

However, GPy can compute this no problem (identical data, identical kernel setup), resulting in this:
Name : GP regression
Objective : -369.9790741292725
Number of Parameters : 11
Number of Optimization Parameters : 11
Updates : True
Parameters:
  GP_regression.                |              value  |  constraints  |  priors
  sum.std_periodic.variance     |    0.0202908485016  |      +ve      |
  sum.std_periodic.period       |<PHONE_NUMBER>47  |      +ve      |
  sum.std_periodic.lengthscale  |<PHONE_NUMBER>63  |      +ve      |
  sum.rbf.variance              |  0.000746482801573  |      +ve      |
  sum.rbf.lengthscale           |      2.94584474279  |      +ve      |
  sum.mul.linear.variances      |     0.157037643245  |      +ve      |
  sum.mul.Mat52.variance        |     0.157037643064  |      +ve      |
  sum.mul.Mat52.lengthscale     |               (3,)  |      +ve      |
  Gaussian_noise.variance       |    0.0137070123953  |      +ve      |

It's not clear what is causing this to happen - the problem setup is essentially identical. It's frustrating because the regression itself is extremely good - when it computes. Am I missing something obvious here? Cheers.

hi,
We are thinking about the best way to solve this type of issue - see #72.
Could you upload a minimal working example that reproduces this behaviour?
There are a couple ways to work around this problem:

adding a small jitter to the diagonal. Add to your kernel a White kernel with a fixed but small variance.
add a logistic transform to constrain the hyperparameters that cause the problem - for example to constraint a parameter to lie in the interval 7.3 to 19.4:
GPflow.transforms.Logistic(7.3, 19.4)

I can add more detail for these solutions if it would be useful.

Hi, thanks for the really fast response! :) I will prepare a minimal example for you asap. In the meantime, I am seeing some progress with fixing some of the hyperparameters - upon further inspection, it appears that the optimization is resulting in some of them being invalid (sometimes NaN, or +Inf). Example:
model.mean_function.c transform:(none) prior:None[ 0.15573284] model.kern.periodickernel.variance transform:+ve prior:None[ 0.] model.kern.periodickernel.lengthscales transform:+ve prior:None[ inf] model.kern.periodickernel.period transform:+ve prior:None[ 86.17313192] model.kern.white.variance transform:+ve prior:None [FIXED][ 0.001] model.kern.prod.linear.variance transform:+ve prior:None[ 0.14613454] model.kern.prod.matern52.variance transform:+ve prior:None[ 0.14613454] model.kern.prod.matern52.lengthscales transform:+ve prior:None[ inf  inf  inf] model.kern.rbf.lengthscales transform:+ve prior:None[ 1.64751096] model.kern.rbf.variance transform:+ve prior:None[ 0.00405476] model.likelihood.variance transform:+ve prior:None[ 0.01931217]
How do I use the logistic transform to constrain a parameter into a range in terms of the syntax - for example, if I wanted to constrain model.kern.periodickernel.lengthscales to non-infinite values? Is there a way I can just constrain every param into a finite range?

Hi,
To add the constraint to your model for a single parameter do
m.kern.matern32.lengthscales.transform = GPflow.transforms.Logistic(0.1, 10.)
This wil constraint the length scale for the Matern to lie in the [0.1,10] interval.
We don't have a mechanism currently to constrain all the parameters. You have to add the constraint to each parameter separately.
We are actively considering how to improve this area so any suggestions and a minimum working example will be very appreciated.

Thank you, I have been able to get the results I wanted by constraining the hyper-parameters. I have created a gist with some data and the python to create the error. I apologise if the demo is still somewhat convoluted/contrived, hopefully it helps in the debugging anyways. Currently using the newest master version of GPflow and TF.
https://gist.github.com/NMRobert/8ea8b621fa12042b1dd78dfb9ca31371

Thanks @NMRobert , I can reproduce the issue. We have a few different possible solutions being discussed that should help.

@NMRobert we've made quite a few changes since this bug was reported. Is this still an issue with the latest version of GPflow? If so it would be great to have an example we can reproduce as a test case. Thanks very much.

Hi Alex,
I've tested on the most recent version of GPflow and the bug does not appear. I was unable to reproduce the issue at all - great work. In addition to this, I noticed that the computation seemed much faster than I remember it being previously. Great work to everybody involved!

I have this issue. I'll post a MVCE

MVCE
https://gist.github.com/Joshuaalbert/e34f71c65b28263161ae09f5b9a6f3be
The data provides an easy to solve problem, yet TF cholesky often fails.
I know that this timeseries has a lengthscale around 200 which is where it is initialized.
I also added an untrainable white kernel of very high variance, and it still fails.
It also fails with and without a mean function.
It also fails with and without the logstic tranform.
Back to the problem
There is a serious problem here guys and gals.
Because of this same issue in my own code, for the exact same problem actually, I've asked that TF provide dynamic exception catching (https://github.com/tensorflow/tensorflow/issues/10332).
In a pythonic solution one would do:
try:
    #method using Cholesky
except:
    #method using svd and pseudo inv/det

This is how I solved this problem in my numpy code dealing with GPs.
The problem is that TF requires doing something like below which can be tedious to code in an elegant way.
def _no_cho_version(...):
    #using svd
def _cho_version(...):
   #using cho as preferable
tf.cond(did_cholesky_fail, _no_cho_version, _cho_version)

try:
    feed_dict[did_cholesky_fail] = False
    sess.run(..., feed_dict=feed_dict)
except:
    feed_dict[did_cholesky_fail] = True
    sess.run(..., feed_dict=feed_dict)

Matrix conditioning might be a solution (but it can fail if the minimum eigen values are set too close to machine precision)
For example the below code would take a non pos-def matrix and make it pos-def.
Kf = (Kf + tf.transpose(Kf,perm=[0,2,1]))/2.
e,v = tf.self_adjoint_eig(Kf)
e = tf.where(e > 1e-14, e, 1e-14*tf.ones_like(e))
Kf_pos_def = tf.matmul(tf.matmul(v,tf.matrix_diag(e),transpose_a=True),v)

Note that cholesky should work for pos-semi-def where there are some zero eigen values. You can test this yourself. So in theory I should be able to replace line e = tf.where(e > 1e-14, e, 1e-14*tf.ones_like(e)) with e = tf.where(e > 0, e, tf.zeros_like(e))
Conditioning the matrix also fails sometimes, because TF has a buggy eigen code.
It only fails when you ask for gradient though; the forward calculation work then.

Hi Guys:
Could you solve the problem? Is there any suggestion
I had the same error when I am using a regression problem with 200 features. I guess it happens when  feature values are sparse ( with a lot of zeros values).


Small fixes in Chars, CharType

@martint i am unsure about Reuse existing padding logic in CharType#getObjectValue commit.
It simplifies code (reuse), but also makes the data be copied twice.
Please decide.

It simplifies code (reuse), but also makes the data be copied twice.

I doubt it matters, so let's keep the commit. We can optimize later if needed.

(AC)


Apparently it's not actually copying the files, because the filesize is still the same as the original one.

Probably needs a Dispose.

Turns out it wasn't actually copying the intended file and was instead copying a different one but using the correct filename.


Update README

[x] Add Table of Contents
[x] Restore Motivation and Challenges
[ ] Add User Stories
[ ] Reference Matrix Format in File formats
[ ] Create documentation subdirectory for images and matrix format specification

This is still in progress. @calvinnhieu - I wanted to ensure that you were comfortable with me inlining Motivations and adding the ToC. I was also thinking about creating a documentation subdirectory for the .svg and the matrix output specification. @mckinsel - is it "safe" to snag your spec from that pending skylab PR? I'd like to add a reference in the File formats section of the README in the .zarr section.

@brianraymor Looks great - thanks for adding more context on the project. Definitely +1 on including Motivation and a ToC, however, I'm less inclined to include the high level descriptions in Challenges as the first thing people read. Do you think it makes sense to pull that section into another document? Also +1 on a subdirectory for docs.

Part of my motivation for adding the table of contents was to allow readers to skip ahead to their area of interest. @mckinsel  - what was the rationale for documenting the Challenges in your original Motivations.md document? @calvinnhieu  - what are your thoughts about inlining our user stories in the README?

@brianraymor I see the value, but maybe not something as raw as "As an investigator, I would like to...". I think a few usage examples (closer to vignettes) would be great!

Closing this pull request. Will re-submit once the README has been updated to reflect the refactored architecture.


Add script to sync staging repo to GCS

Repurposes the preprod sync script, updating the paths to the staging repository folder, the GCS bucket name, and the workload identity pool and service account.

Summary

Release Note

Documentation

Would like to merge this before https://github.com/sigstore/root-signing/pull/799 to confirm it works


Update storybook configs

What this PR does / why we need it:

Use @storybook/addon-essentials
update versions

Which issue(s) this PR fixes:
Fixes #
Does this PR introduce a user-facing change?:

NONE

Looks nice.
/approve


Workaround for the SQLite download step in our build

SQLite download fails on Mono because of https://bugzilla.xamarin.com/show_bug.cgi?id=30686

Should help us get rid of those pesky Travis CI "build failed" emails.

(Transitive :shipit: via #89)


Update Reminder Logic

Refactored SortedList for reminders into Model.
Refactored dates to follow Birthday logic.
Add indexing of Reminders in the list of reminders.
Add methods to retrieve reminder list and remove reminders.

Codecov Report

Merging #98 (f0960f1) into master (83fdecf) will increase coverage by 1.08%.
The diff coverage is 55.81%.

@@             Coverage Diff              @@
##             master      #98      +/-   ##
============================================
+ Coverage     68.96%   70.04%   +1.08%
- Complexity      475      482       +7
============================================
  Files            91       90       -1
  Lines          1698     1686      -12
  Branches        178      180       +2
============================================
+ Hits           1171     1181      +10
+ Misses          470      444      -26
- Partials         57       61       +4

Impacted Files
Coverage Δ

...rc/main/java/seedu/address/logic/LogicManager.java
71.42% <0.00%> (-3.58%)
:arrow_down:

.../seedu/address/logic/commands/ReminderCommand.java
0.00% <0.00%> (ø)

...du/address/logic/parser/ReminderCommandParser.java
0.00% <0.00%> (ø)

src/main/java/seedu/address/model/Model.java
100.00% <ø> (ø)

...c/main/java/seedu/address/model/person/Person.java
90.58% <0.00%> (-2.19%)
:arrow_down:

.../java/seedu/address/storage/JsonAdaptedPerson.java
97.26% <0.00%> (ø)

src/main/java/seedu/address/ui/MainWindow.java
0.00% <0.00%> (ø)

src/main/java/seedu/address/ui/ReminderCard.java
0.00% <0.00%> (ø)

.../main/java/seedu/address/ui/ReminderListPanel.java
0.00% <0.00%> (ø)

.../java/seedu/address/logic/commands/AddCommand.java
86.66% <50.00%> (-13.34%)
:arrow_down:

... and 7 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Universal instance type

https://www.pivotaltracker.com/story/show/126630419
https://www.pivotaltracker.com/story/show/128009829

Approved.

Add unit-tests, please

@nmenardg We should add a test for RequestEvent and BaseView constructors to make sure they specify a initial_state.
@nikitagromov The unit test in the framework are not very good in my opinion, IMO its useless to test everything and the test that we have right now are nothing but change detectors.

Approved

Waiting for fix typo and then Approved

Approved


Move some javascript global variables to unread.js.

I decided to work on https://github.com/zulip/zulip/issues/610 while trying to get familiar with zulip.
function process_loaded_for_unread had the description:

This is annoying to move to unread.js because the natural name	,would be unread.process_loaded_messages, which this calls

I guess it can be renamed to something like process_unread_loaded_messages.
Do you have any suggestions?

Automated message from Dropbox CLA bot
@Frouk, it looks like you've already signed the Dropbox CLA. Thanks!

Thanks for working on this @Frouk!
For the first commit, I think we should make the new variable unread.messages_read_in_narrow, rather than having the variable name have the module name in it.
For process_loaded_for_unread, I'm not sure what the right thing to do is.  The function only partially has to do with unread message processing at all, and probably needs some more complex refactoring.  Let's leave it as-is until I can find time to fix it properly.

@Frouk thanks for working on this!  A few notes:

In the future, please post a comment on the pull request when you updated your branch -- Github doesn't send any sort of notification when people update branches.
Can you squash your commits together and shorted the commit message something like Move global unread_messages_read_in_narrow to unread.js.?
Can you use git commit --amend --reset-author to fix your name on your commit to not be "Your Name"?
Can you fix the last reference to this in check-all.js:

tabbott@zaset:~/zulip$ git grep unread_messages_read_in_narrow
tools/jslint/check-all.js:    + ' keep_pointer_in_view unread_messages_read_in_narrow'

Thanks!

Thank you very much for your useful notes!
I believe i fixed them all.
Sorry for the inconvenience, i am still learning how pull request work.
When i get the time i will study zulip in depth and provide more useful contribution.

Merged, thanks @Frouk !  No worries about learning how pull requests work -- everyone has to learn sometime :)


Optical flow for training

Thanks for your great job! I want to train DA-VSN, but I don't know how to get Estimated_optical_flow_Viper_train, Estimated_optical_flow_Cityscapes-Seq_train. I didn't find the detail about optical flow from readme or paper.

Hi @EDENpraseHAZARD, thank you for your interest in our work.
Please follow the steps below to get optical flow:

git clone https://github.com/NVIDIA/semantic-segmentation/tree/sdcnet/sdcnet;

Download the
Code_for_Optical_Flow_Estimation.zip and unzip these files in the folder of sdcnet;

Run the shell scripts to generate optical flow:
[1] CItyscapes validation set: "python Cityscapes_val_optical_flow_scale512.py --pretrained ../pretrained_models/sdc_cityscapes_vrec.pth.tar --flownet2_checkpoint ../pretrained_models/FlowNet2_checkpoint.pth.tar --source_dir ../../data/Cityscapes --target_dir Cityscapes_val_optical_flow_scale512 --vis --resize 0.5"
[2] SynthiaSeq train set: "python Estimated_optical_flow_SynthiaSeq_train.py --pretrained ../pretrained_models/sdc_cityscapes_vrec.pth.tar --flownet2_checkpoint ../pretrained_models/FlowNet2_checkpoint.pth.tar --source_dir ../../data/SynthiaSeq/SEQS-04-DAWN/rgb --target_dir Estimated_optical_flow_SynthiaSeq_train --vis --resize 0.533333"
[3] Viper train set: "python Estimated_optical_flow_Viper_train.py --pretrained ../pretrained_models/sdc_cityscapes_vrec.pth.tar --flownet2_checkpoint ../pretrained_models/FlowNet2_checkpoint.pth.tar --source_dir ../../data/viper --target_dir /home/dayan/gdy/adv/snapshots/Estimated_optical_flow_Viper_train--vis --resize 0.533333"

(Please note that we only use the FlowNet2 to estimate optical flow, and apply the SDCNet to check whether the estimated optical flow is right.)

And Cityscapes training set also uses CItyscapes validation set.
Thank you.

And CItyscapes training set also uses Cityscapes_val_optical_flow_scale512.py.
Thank you.

Hi author, I have another question. The link of download SYNTHIA-Seq is not access. I download this data from here http://synthia-dataset.net/downloads/ and I find in '/SYNTHIA-SEQS-04-DAWN/RGB' there are 'Stereo_Left' and 'Stereo_Right' folder. And in each folder, there are 'Omni_B', 'Omni_F', 'Omni_L' and 'Omni_R'. I wonder which one is used to train DA_VSN.

Dear author, I have another two questions.
1、How many gpus you used for training?
2、How many iterations are need for training?
In config.py, I find two parameters about the iterations, I wonder which one leads to the final result.

Also, I try to train Viper2Citys using one 1080Ti, and the total training time is about 96h under 120000 iters setting. I think the training time is so long. So I want to know the training detail.

Hi @EDENpraseHAZARD, the training details are the same as ADVENT (https://github.com/valeoai/ADVENT). For example, the total training iteration is 120k.

Thanks!

I use the folloeing shell scripts, but got error.
[2] SynthiaSeq train set: "python Estimated_optical_flow_SynthiaSeq_train.py --pretrained ../pretrained_models/sdc_cityscapes_vrec.pth.tar --flownet2_checkpoint ../pretrained_models/FlowNet2_checkpoint.pth.tar --source_dir ../../data/SynthiaSeq/SEQS-04-DAWN/rgb --target_dir Estimated_optical_flow_SynthiaSeq_train --vis --resize 0.533333"

I can't get synthia-seq flow

The estimated optical flows of all datasets can be accessed via the link below:
https://drive.google.com/drive/folders/1i_-yw9rS7-aa7Cn5ilIMbkUKwr1JpUFA?usp=sharing

Hi @ldkong1205 @EDENpraseHAZARD , the code of TPS [ECCV 2022] is available here. TPS is 3x faster than DA-VSN during training and notably surpasses DA-VSN during testing.

I use the folloeing shell scripts, but got error. [2] SynthiaSeq train set: "python Estimated_optical_flow_SynthiaSeq_train.py --pretrained ../pretrained_models/sdc_cityscapes_vrec.pth.tar --flownet2_checkpoint ../pretrained_models/FlowNet2_checkpoint.pth.tar --source_dir ../../data/SynthiaSeq/SEQS-04-DAWN/rgb --target_dir Estimated_optical_flow_SynthiaSeq_train --vis --resize 0.533333"

I can't get synthia-seq flow

Hello, have you solved this problem？


Zero-copy put

Curious if you know whether it might be possible to put a Nim table into nimdbx without any copying, or is that nonsensical? I'm basically wondering if it's possible to skip serialization altogether and effectively transfer ownership of the memory taken by a Nim table over to nimdbx. Thanks!

I guess it doesn't make sense for nimdbx to manage a pointer outside its file, so forget that question. Still curious... can I skip serialization and basically store a Nim table in the database?


[SPARK-13016] [Documentation] Replace example code in mllib-dimensionality-reduction.md using include_example

Replaced example example code in mllib-dimensionality-reduction.md using
include_example

Can one of the admins verify this patch?

ok to test

@yinxusen Could you help review this PR? Thanks!

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51141/
Test FAILed.

ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/spark.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:763)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1012)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1043)

Jenkins failed fetch the code, Can you retest it? Thanks

Jenkins, retest this please

Test build #51302 has started for PR 11132 at commit 488f09c.

Test build #51302 has finished for PR 11132 at commit 488f09c.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
public class JavaPCAExample
public class JavaSVDExample

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51302/
Test PASSed.

Test build #51413 has started for PR 11132 at commit 2ada7ef.

Test build #51413 has finished for PR 11132 at commit 2ada7ef.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51413/
Test PASSed.

@yinxusen Thanks for reviewing, I have addressed the comments, Please have a look into this.

Test build #51479 has started for PR 11132 at commit 95d78fe.

Test build #51479 has finished for PR 11132 at commit 95d78fe.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51479/
Test PASSed.

Merged build finished. Test PASSed.

Thanks @yinxusen for the review, I have addressed them.

@devaraj-kavali All look good except those minors.

Test build #51521 has started for PR 11132 at commit acd88f2.

Test build #51521 has finished for PR 11132 at commit acd88f2.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51521/
Test PASSed.

Merged build finished. Test PASSed.

Thanks again @yinxusen for the review, I have addressed them.

@mengxr LGTM

Test build #51641 has started for PR 11132 at commit 3b031da.

Test build #51641 has finished for PR 11132 at commit 3b031da.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51641/
Test PASSed.

Merged into master. Thanks!
@yinxusen For really small code snippets, we could either leave them in the user guide, or consider merging SPARK-11399 first. Otherwise, we might end up with too many example files.

@mengxr, do you have time to make a pass of SPARK-11399?
2016年2月22日星期一，asfgit<EMAIL_ADDRESS>写道：

Closed #11132 https://github.com/apache/spark/pull/11132 via 9f41087
https://github.com/apache/spark/commit/9f410871ca03f4c04bd965b2e4f80167ce543139
.
—
Reply to this email directly or view it on GitHub
https://github.com/apache/spark/pull/11132#event-560750238.

--
Cheers
Xusen Yin    (尹绪森)
LinkedIn: https://cn.linkedin.com/in/xusenyin


Update for Xcode 7.0

Xcode 7.0 shows a warning requesting to upgrade project settings. This patch does it.

Replaced by 32923fa which actually upgrades to Xcode 7.1


Hiding on page blur

When links have tooltips, if you ctrl-click them to open in a new tab, the original tab will end up with a "stuck" tooltip, i.e. it the mouseLeave doesn't trigger despite the mouse having moved in the newly-opened tab.
My naive idea would be to add a window blur-event-listener in listenForTooltipExit but maybe it should be statically installed listener. Or something else. Haven't tested at all.
Any hints about sensible implementations? I can prepare a PR.

My only concern is about performance if we have a lot of tooltips on the same page, a lot of listeners will probably be added for each tooltip, but this is an already known problem from V4.
Please, do a PR for that, and thanks for reporting, I'll check the V5 implementation and see if this occurs in V5.

Closing all v4 issues due to V5 released.
If necessary, please open a new issue using V5, thanks!


On Docker For Mac does not handle suspend/resume well

Yes, there are a few issue that hadn't been determined just yet. Also, right now #136 causes a much bigger problem. It would be great to identify what exactly is the issue, I think it's basically the case of pods not coming back, as the Docker for Mac VM effectively reboots on resume, however until recently Docker for Mac ate 200% of CPU and required app restart.


Padding / Margin on Input with InputAdd when the value is emptied (safari only)

Describe the bug
The issue occurs when there is a value in the input, if you delete everything, a padding or margin is added below the field, if you set another value the padding is removed.
On Firefox, Chrome, and Edge, everything works as expected; the problem is only present on Safari (tested on Safari 16.6).
Reproduction
https://flowbite-svelte.com/docs/forms/input-field#Input_group (2nd input only)
Flowbite version and System Info
System:
    OS: Windows 10 10.0.19045
    CPU: (8) x64 Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz
    Memory: 11.80 GB / 31.91 GB
  Binaries:
    Node: 18.15.0 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.22.18 - ~\AppData\Roaming\npm\yarn.CMD
    npm: 9.5.0 - C:\Program Files\nodejs\npm.CMD
  Browsers:
    Edge: Spartan (44.19041.1266.0), Chromium (116.0.1938.76)
    Internet Explorer: 11.0.19041.1566
  npmPackages:
    @sveltejs/kit: ^1.20.4 => 1.23.0
    flowbite-svelte: ^0.44.4 => 0.44.4
    svelte: ^4.2.0 => 4.2.0
    vite: ^4.4.2 => 4.4.9

I can't reproduce it.

Do you tried with Safari 16.6? Someone reported me this issue, I can't try on my computer (I'm on Windows) but I've tried on browser stack and I have the same issue.
I fill the input, remove everything and a weird padding appear. I can make a short video if needed

Did you try Safari v17.1?
Please show us a video.


Which Coding YouTube channels do you look up to?

None. I prefer reading books on topics. Gives me in-depth knowledge.
For channels which I recommend for students I have done few posts on instagram. Please check that.


syntax options for max rollover files and max size are not documented

When creating an XEvent session you have the ability in the GUI to specify whether files roll over or not, and the size for when they rollover.   The script generated by SSMS has the following:
CREATE EVENT SESSION [test] ON SERVER
ADD EVENT sqlserver.deprecation_announcement,
ADD EVENT sqlserver.deprecation_final_support
ADD TARGET package0.event_file(SET filename=N'test',max_file_size=(2048),max_rollover_files=(6))
GO
But nowhere on the page are "max_file_size" and "max_rollover_files" mentioned

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3b79d736-c8b0-a460-501a-71c590092bc9
Version Independent ID: f5c34ba9-0a5d-0af5-c4e5-c99d5572e6d5
Content: CREATE EVENT SESSION (Transact-SQL) - SQL Server
Content Source: docs/t-sql/statements/create-event-session-transact-sql.md
Product: sql
Technology: t-sql
GitHub Login: @CarlRabeler
Microsoft Alias: carlrab

The related XEvent articles do mention 'max_rollover_files':

https://docs.microsoft.com/en-us/sql/relational-databases/extended-events/quick-start-extended-events-in-sql-server?view=sql-server-2017
https://docs.microsoft.com/en-us/sql/database-engine/event-file-target?view=sql-server-2014 (NOT available for 2016+).

Generally, I think the names of specific actual parameters are documented at the 'package' level, because there is no way that the Transact-SQL CREATE EVENT SESSION can know what packages the world might create and what parameters those packages might want.

@TrayceJ -- Hi Trayce.  Thank you for your feedback.  I believe Gene's comment above answers your question.
I am closing this issue now.  You are welcome to @ mention me for any followup.
We hope to hear from you again.

@WilliamAntonRohm - i think this is still a problem. Where is the documentation for max_file_size, or at least a mention of what the units are? The page you linked to https://docs.microsoft.com/en-us/sql/relational-databases/extended-events/quick-start-extended-events-in-sql-server?view=sql-server-2017 doesn't document it.

@rjk -- Rory, thank you for your feedback.  Please consider these resources:

Visual Studio on Q&A
Visual Studio MSDN Forum
Stack Overflow
Reddit

@CarlRabeler -- Carl, please look into this issue.

Carl.R is no longer on the SQL content team. So,...
...I am unassigning Carl, and assigning @rothja who can decide who this Issue #2333 should be assigned to on his team.

@markingmyname Mark, can you please take a look at this git issue? Thank you! #reassign:markingmyname

@TrayceJ @markingmyname I found the following external blog post that describes these parameters and connects them to options in the UI: Extended Events File Target – File Rollover and Max File Size settings. You are absolutely right that they are not (and should be) documented in this reference topic. @markingmyname, maybe we could use the blog post to write up some quick descriptions of these options in the CREATE EVENT SESSION (Transact-SQL) - SQL Server reference article and then confirm this with the PG.

https://github.com/MicrosoftDocs/sql-docs/issues/2333
Created PR - https://github.com/MicrosoftDocs/sql-docs-pr/pull/17659
REached out to PG to confirm changes

Hi, @TrayceJ
These settings are documented here: https://docs.microsoft.com/previous-versions/sql/sql-server-2016/ff878115(v=sql.130)
They do not apply to the session level, they only apply to the event_file target.
The max_file_size and max_rollover_files are modifiers of the event_file Target.
The syntax looks like this:
CREATE EVENT SESSION [test] ON SERVER
ADD EVENT sqlserver.existing_connection(
ACTION(package0.event_sequence,sqlserver.session_id)),
ADD EVENT sqlserver.login(SET collect_options_text=(1)
ACTION(package0.event_sequence,sqlserver.session_id)),
ADD EVENT sqlserver.logout(
ACTION(package0.event_sequence,sqlserver.session_id))
ADD TARGET package0.event_file(SET filename=N'test',max_file_size=(512),max_rollover_files=(10))
WITH (MAX_MEMORY=8192 KB,EVENT_RETENTION_MODE=ALLOW_SINGLE_EVENT_LOSS,MAX_DISPATCH_LATENCY=5 SECONDS,MAX_EVENT_SIZE=0 KB,MEMORY_PARTITION_MODE=PER_CPU,TRACK_CAUSALITY=ON,STARTUP_STATE=OFF)
GO
We are discussing how to update this article.
Hope this helps.
thank you.

We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion, and we will reopen the issue. To see what the community is wanting, please visit the SQL Server User Feedback site.

@markingmyname - that's a useful page ( https://docs.microsoft.com/previous-versions/sql/sql-server-2016/ff878115(v=sql.130) ) but I don't think it's currently findable through docs.microsoft.com!? I've tried searching in a number of ways and can't see how to find the page unless you have the direct link. Could we add a reference from https://docs.microsoft.com/en-us/sql/relational-databases/extended-events/targets-for-extended-events-in-sql-server?view=sql-server-ver15 for example, and/or update the page so it's available from Search?

This documentation bug STILL EXISTS after almost 10 years.


Redesigning the FAQs section

@thestarsahil a lot has changed after I made this FAQs section
Now I want to add few more details to it

I good to look this , no need

It's good to look this , no need

That's help section contains a different faq
I thought of merging both here


Report status for all cinder services

This fix resolves an issue where not all cinder service status were
reported as metrics.
cinder services should now have metrics created correctly based on the
services that are available on the host.
Additionally checks for cinder services needed to be fixed:

Checks for each cinder backend are now created dynamically
Check for cinder-backup service is created
maas-exclude task is fixed to match the "--" used by all local checks

For the backport we need to exclude the previous 'cinder_volume_check'
using the maas_excluded_checks: var. This ensures upgrades will work.
 This is affecting a lot of jenkins kilo-liberty upgrade jobs, as well as just kilo jobs.

@andymcc The format for connecting a PR to a bug is:
Connected https://github.com/rcbops/rpc-openstack/issues/0
No colon is needed. Thanks!

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

recheck_ceph

RPC-AIO-Ceph-Kilo-PR: Fail

Might not make sense to keep having Jenkins retry this because:
14:50:13 Need to get 1473 kB/27.5 MB of archives.
14:50:13 After this operation, 117 MB of additional disk space will be used.
14:50:13 Err http://mirror.rackspace.com/ubuntu/ trusty-security/main mysql-common all 5.5.50-0ubuntu<IP_ADDRESS>
14:50:13   404  Not Found
14:50:13 Err http://mirror.rackspace.com/ubuntu/ trusty-security/main libmysqlclient18 amd64 5.5.50-0ubuntu<IP_ADDRESS>
14:50:13   404  Not Found
14:50:13 Err http://mirror.rackspace.com/ubuntu/ trusty-security/main libmysqlclient-dev amd64 5.5.50-0ubuntu<IP_ADDRESS>
14:50:13   404  Not Found
14:50:13
14:50:13 msg: Task failed as maximum retries was encountered
14:50:13
14:50:13 FATAL: all hosts have already failed -- aborting
14:50:13
14:50:13 PLAY RECAP ********************************************************************
14:50:13            to retry, use: --limit @/jenkins/setup-infrastructure.retry

Looks like our mirror is out-of-date?

mirror has been broken all afternoon
recheck_upgrade

recheck_ceph

This looks great to me. 👍

👍


fix: Remove null type cast in receipt_remote_data_source.dart

Closes #426

has this been fixed in the backend?

has this been fixed in the backend?

Yes, https://github.com/AnalogIO/coffeecard_app/issues/426#issuecomment-1546760135


Noob Question: Why SCIM while keycloak already provide rest api to manage users and groups

The only advantage I can think of is:

SCIM is a standard.

Can you guys enlighten me a bit more.

Hi,
the reason as you say because SCIM is a standard. Other providers like AWS, Microsoft Azure AD, Atlassian etc. are implementing SCIM exactly for the purpose of user and group provisioning. So as long as you do not have the need to link such services with your keycloak there is no need for you to use SCIM. But as soon as you want user and group provisioning in cloud environments or similiar this is the solution to go.


Do not validate users when pull-request is from the same repository

Changes
Though user is not owner/collaborator/public member or in owner files but has permission to push to branches inside repository then PAC should allow triggering CI for pull-request create in the same repository
Fixes : https://issues.redhat.com/browse/SRVKP-2846

Submitter Checklist

[ ] ♽  Run make test lint before submitting a PR (ie: with pre-commit, no need to waste CPU cycle on CI
[ ] 📖 If you are adding a user facing feature or make a change of the behavior, please verify that you have documented it
[ ] 🧪 100% coverage is not a target but most of the time we would rather have a unit test if you make a code change.
[ ] 🎁 If that's something that is possible to do please ensure to check if we can add a e2e test.
[ ] 🔎 If there is a flakiness in the CI tests then don't necessary ignore it, better get the flakyness fixed before merging or if that's not possible there is a good reason to bypass it. (token rate limitation may be a good reason to skip).

Yet to handle for GitLab, Bitbucket

We need some investigation or at least issue filed for how to do that on other providers...

We need some investigation or at least issue filed for how to do that on other providers...

Yes
I will create another story and will work on that

maybe remove dependabot from the owners file https://github.com/openshift-pipelines/pipelines-as-code/blob/main/OWNERS so we know next time dependabot sending a pr if it works or not.... that would be your e2e test for this feature.


Developer documentation for testing and production

Coverage remained the same at 46.342% when pulling 3d7949394c48f1caf44a7e232e6fae67ff51b625 on docs into 59e5a7cd39b567cab1c33035edeaf716f8357c5d on master.


Fix some non-standard comments

description
Fix some non-standard comments
use tool of idea 'replaceAll', and check  them in local
why need
it will cause some method can't generate doc
please view the site https://pekko.apache.org/japi/pekko/current/org/apache/pekko/stream/scaladsl/Source.html

and some changes maybe not included in doc, I also believe it is necessary to be more standardized for comment
test
just add * for comment, not need test local,it will passed by CI

Thanks , for new contributor from China:)


Does this support Python 3?

setup.py does not contain classifiers indicating support for Python 3, and .travis.yml and tox.ini both don't test against Python 3.
Is this library meant to support Python 3?

Yes, it is. Python 3 support has been added in commit https://github.com/TriplePoint-Software/django_audit_trail/commit/eb99d6ea942e48eb680fa33cb9b7f832486ed629

@Flimm willing add python3 tests soon, but it works with py3


feat: added unix commands

Fixes JX9-231209-3 and JX9-231209-5

@dune73 This PR is for a fix to 3.3. Do we do that? I'm not sure of the process here.

I've one more commit fix for this, and I won't  push if it's not necessary.

@Xhoenix We discussed this PR during the issue chat. We usually do not patch past releases, apart from really critical things (say Log4Shell, for example). The main reason for this is that we do not want to introduce new false positives into highly tuned systems.

JX9-231209-3 is more critical than Log4Shell, IMO. Log4Shell will only work on Java webservers, but JX9-231209-3 is for all unix servers. But, you're also right about providing support to past releases, as v4 release is coming near. So, it's okay if we drop this. :-)


[Idea: DeviceEventEmitter] Namespace device events

Since the device event emitter is shared by every module in the app it might be a good idea to namespace the events. This could be part of the native API for sending events like:
[self.bridge.eventDispatcher sendDeviceEventWithNamespace:@"React"
  name:@"appStateDidChange"
  body:...]

which emits an event named "React.appStateDidChange".

Thank you for reporting this issue and appreciate your patience. We've  notified the core team for an update on this issue. We're looking for a response within the next 30 days or the issue may be closed.


[cmap] What is the meaning of "symbol font"?

The meaning of "symbol font" is not clear in the statement "When building a symbol font for Windows, the platform ID should be 3 and the encoding ID should be 0."
I assume it refers to the old 8-bit character set of MS Symbol, which (I think) used character IDs 32-255 without any 16-bit interlopers. In issue #269 (July 2019) about cmap subtable relevance, @behdad mentions "hacky symbol fonts", presumably referring to the same thing. In any case, some attempt should be made in the ‘cmap’ spec to explain how to map arbitrary sets of graphics to Unicode codepoints, and to move away from the simplistic phrase "symbol font" since a valid font may have any number of symbols and any number of alphabetic characters.
 Nevertheless builders of such fonts often want to add handy alphabetic keystrokes to their fonts. Which is hackier, the old-style 3/0 symbol fonts (which mapped A,B,C… to arbitrary glyphs) or pointing A,B,C… at arbitrary glyphs using 3/1?
It’s worth noting that there are popular counterexamples where "handy A,B,C mapping" is not used. For example, FontAwesome publishes fonts that use PUA exclusively and offers mechanisms outside of the font (CSS classes) for handy usage.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 86923ff4-2b60-9144-e2b4-77cdb36fd698
Version Independent ID: ea221e53-f51a-8233-3c0b-d416e5360623
Content: cmap - Character To Glyph Index Mapping Table - Typography
Content Source: typographydocs/opentype/spec/cmap.md
Product: typography
GitHub Login: @PeterCon
Microsoft Alias: PeterCon

The Symbol encoding is... interesting. It was defined for TrueType outline fonts, not earlier bitmap fonts (though maybe some earlier fonts got ported to TT symbol-encoded fonts). I can't find any evidence that "symbol" fonts ever used anything but a format 4 cmap, even in the Windows 3.1x timeframe.
MS Office treats these in a very special way, which may well date to Word for DOS. Try this (it works in desktop Word on Windows, not sure about Mac):

enter into a new doc "F0A7" (without quotation marks), then press Alt+X (to convert to Unicode character U+F0A7).
format that text with the "Symbol" font
Result: you should see a club (playing card) symbol
On a new line, set the font to Calibri, enter "A7" (without quotation marks), then press Alt-X (to convert to Unicode character U+00A7).
Format that text with the Symbol font
Result: the club symbol
Check that you can select either of the characters entered above, press Alt-X, and that you'll get back the string "F0A7" (formatted with Symbol)
Using Words Insert > Symbol dialog, change the font to Symbol, locate and enter the club sign
Select that symbol and press Alt-X
Result: nothing: it won't give the underlying encoding of a symbol entered from the Insert > Symbol dialog.

Now, in the font, the symbols are encoded using a format 4 cmap subtable, with 224 symbols starting at 0xF020. (It's not a Unicode encoding, so it's not U+F020.)
So, notice that you can use U+F0A7 to access the symbol encoded as 0xF0A7. But you could also use U+00A7 to access the same symbol. IOW, U+0020 .. U+00FF gets mapped into the font's 0xF020 .. 0xF0FF.
I haven't confirmed with any Word engineer, but I surmise it's treating characters entered with the selected font being a symbol-encoded font using a single-byte encoding. This stuff worked in Word before Word starting using Unicode in Word 97. And IIRC you can save to RTF and unpack what is effectively single-byte encoding.
But wait, there's more!
Back around 1997, Bob Hallissy and I did an experiment with symbol encoding in which we created a font with 3/0/4 cmap, but with 224 characters encoded at a different starting code position—I forget what, but something like 0xE000. And we changed the OS/2.usFirstCharIndex value to match that. Result: it worked in Word and other Win9x (non-unicode) apps just like any other symbol-encoded font.

Here's a proposed draft change for the next version, in the "Windows platform (platform ID = 3)" section:

When building a symbol font for Windows, the platform ID should be 3 and the encoding ID should be 0.The symbol encoding was created to support fonts with arbitrary ornaments or symbols not supported in Unicode or other standard encodings. A format 4 subtable would be used, typically with up to 224 graphic characters assigned at code positions beginning with 0xF020. This corresponds to a sub-range within the Unicode Private-Use Area (PUA), though this is not a Unicode encoding. In legacy usage, some applications would represent the symbol characters in text using a single-byte encoding, and then map 0x20 to the OS/2.usFirstCharIndex value in the font. In new fonts, symbols or characters not in Unicode should be encoded using PUA code points in a Unicode 'cmap' subtable.


ARCMWDT: Fix building under hwmv2 model

On very early stage build system needs to get access to DTC preprocessor. MWDT has no it's own preprocessor, so here zephyr-SDK preprocessor is used. At the same time zephyr-SDK requires ARCH variable to be initialized before include "generic.cmake", but in hew HWMv2 model ARCH variable will be initialized more later. This workaround uses any (first awailable, independent on ARCH) toolchain from SDK for DTC preprocessing only. For other build stages ARCMWDT will be used.

@evgeniy-paltsev , could you please take a look?

Workaroud for https://github.com/zephyrproject-rtos/zephyr/issues/70508


-4 collections

Describe the bug
-4 collections on this kata
To Reproduce
Go to oldest 7 kyu kata
https://www.codewars.com/kata/514a677421607afc99000002
Expected behavior
collections must be 0 or more
Screenshots

Browser
Chrome 89 but it doesn't matter anyway I suppose

OS: macOS
Browser chrome
Version 89

Additional context
What else can I say??

Duplicate of #2185


Make secret validation more pluggable

for both client and api secrets

extract interface from ClientSecretValidator and ApiSecretValidator
use interfaces in code
allow replacement of implementation via DI

@leastprivilege,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot


Update Changelogs for v 3.3.0

### Tasks
- [x] Metadata Harvester
- [x] Metadata Validator

https://github.com/cessda/cessda.metadata.harvester/commit/8c6d07d1f14b7bd57ce24782a6936297867617bc

https://github.com/cessda/cessda.cmv.console/commit/f3212b312001bd060627009bfefe8dbd33bc8f7a

All changelogs updated

DOIs have been added to the harvester and the validator


⚠ Cioos National CKAN has degraded performance

In f054b87, Cioos National CKAN (https://catalogue.cioos.ca/) experienced degraded performance:

HTTP code: 200
Response time: 14197 ms

Resolved: Cioos National CKAN performance has improved in f61d3aa after 11 minutes.


Unable to open version 0.4

Previously I could open v0.3.1, however it failed to display any devices under my device group manager.  I fixed this by unblocking the zip in the properties context menu then extracting it.  On 0.4 I got the same issue, it opens, no devices are listed.  However when doing the same method of unblocking the zip, it now crashes the moment I try to open. Giving me a generic this application stopped working message. Here is the log.
2018-10-07.log

Do note that I also tried adding in a context.xml file that I generated with 0.4 (a version I didn't unblock) and get this log.
2018-10-08.log

I personally never do it by unblocking the ZIP itself, I do it by altering the permissions on the files themselves after extracting.
Try running the following Powershell command as admin in the UCR folder: Get-ChildItem -Path '.' -Recurse | Unblock-File

Problem was that user had dupe keyboards, and the Interception fix for dupe devices did not make it in to 0.4


consider using either node-raknet or pmp

Hi!
I've created a module for assisting with the raknet protocol in node: https://github.com/mhsjlw/node-raknet and I've created a module for creating clients and servers for MCPE: https://github.com/mhsjlw/pocket-minecraft-protocol
I hope this helps!

That's awesome. I will definitely consider using it in this project.

If you need help or have any questions whatsoever join us in the pocket minecraft protocol gitter and we'll see what we can do both raknet or mcpe related