Add minimum Python version.

This looks like an interesting tool, and I
wanted to try it out. After failing to
install via pip, I figured out that some of
the transitive requirements
(jsonschema, semver) require python
3.9+. I want to save the time of the next
person that tries to install this via pip.
Log when trying to install via pip on
python3.6:

Python 3.6 Install Log
[root@16cfcb563a46 /]# python3 -m pip install ostorlab
WARNING: Running pip install with root privileges is generally not a good idea. Try `__main__.py install --user` instead.
Collecting ostorlab
  Downloading https://files.pythonhosted.org/packages/7b/77/61cd3a5023b41b53fc8b1711d288f7501397965384664041bea1855d4f05/ostorlab-0.18.18-py3-none-any.whl (691kB)
    100% |████████████████████████████████| 696kB 2.2MB/s
Collecting rich (from ostorlab)
  Downloading https://files.pythonhosted.org/packages/32/60/81ac2e7d1e3b861ab478a72e3b20fc91c4302acd2274822e493758941829/rich-12.6.0-py3-none-any.whl (237kB)
    100% |████████████████████████████████| 245kB 501kB/s
Collecting google-cloud-logging (from ostorlab)
  Downloading https://files.pythonhosted.org/packages/26/b4/05fecd87f8280af687e98489663fc67a5faadd1cb2c0ad8e8c8820941067/google_cloud_logging-3.1.2-py2.py3-none-any.whl (188kB)
    100% |████████████████████████████████| 194kB 4.3MB/s
Collecting importlib-metadata; python_version < "3.8" (from ostorlab)
  Downloading https://files.pythonhosted.org/packages/a0/a1/b153a0a4caf7a7e3f15c2cd56c7702e2cf3d89b1b359d1f1c5e59d68f4ce/importlib_metadata-4.8.3-py3-none-any.whl
Collecting semver>=3.0.0 (from ostorlab)
  Could not find a version that satisfies the requirement semver>=3.0.0 (from ostorlab) (from versions: 0.0.1, 0.0.2, 2.0.0, 2.0.1, 2.0.2, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.3.0, 2.3.1, 2.4.0, 2.4.1, 2.4.2, 2.5.0, 2.6.0, 2.7.0, 2.7.1, 2.7.2, 2.7.3, 2.7.4, 2.7.5, 2.7.6, 2.7.7, 2.7.8, 2.7.9, 2.8.0, 2.8.1, 2.9.0, 2.9.1, 2.10.0, 2.10.1, 2.10.2, 2.11.0, 2.12.0, 2.13.0, 3.0.0.dev1, 3.0.0.dev2, 3.0.0.dev3)
No matching distribution found for semver>=3.0.0 (from ostorlab)

Log when trying to install/run
via pip on python3.8:

Python 3.8 Install/Run Log
[root@d0cd328d21b8 /]# python3.8 -m pip install ostorlab
WARNING: Running pip install with root privileges is generally not a good idea. Try `python3.8 -m pip install --user` instead.
Collecting ostorlab
# ... lots of pip faffing about...
Successfully built nats-py
ERROR: googleapis-common-protos 1.62.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: grpcio-status 1.60.0 has requirement protobuf>=4.21.6, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: google-api-core 2.15.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: grpc-google-iam-v1 0.13.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: google-cloud-appengine-logging 1.4.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: google-cloud-audit-log 0.2.5 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
ERROR: google-cloud-logging 3.9.0 has requirement protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
Installing collected packages: ruamel.yaml.clib, ruamel.yaml, protobuf, click, py-ubjson, nats-py, semver, charset-normalizer, urllib3, idna, certifi, requests, googleapis-common-protos, pyasn1, pyasn1-modules, rsa, cachetools, google-auth, grpcio, grpcio-status, google-api-core, proto-plus, grpc-google-iam-v1, google-cloud-core, google-cloud-appengine-logging, google-cloud-audit-log, google-cloud-logging, attrs, rpds-py, referencing, zipp, importlib-resources, pkgutil-resolve-name, jsonschema-specifications, jsonschema, soupsieve, beautifulsoup4, six, markdownify, importlib-metadata, greenlet, sqlalchemy, typing-extensions, MarkupSafe, Mako, alembic, packaging, docker, tenacity, mdurl, markdown-it-py, pygments, rich, ostorlab
    Running setup.py install for py-ubjson ... done
Successfully installed Mako-1.3.0 MarkupSafe-2.1.3 alembic-1.13.1 attrs-23.2.0 beautifulsoup4-4.12.2 cachetools-5.3.2 certifi-2023.11.17 charset-normalizer-3.3.2 click-8.1.7 docker-7.0.0 google-api-core-2.15.0 google-auth-2.26.2 google-cloud-appengine-logging-1.4.0 google-cloud-audit-log-0.2.5 google-cloud-core-2.4.1 google-cloud-logging-3.9.0 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpc-google-iam-v1-0.13.0 grpcio-1.60.0 grpcio-status-1.60.0 idna-3.6 importlib-metadata-7.0.1 importlib-resources-6.1.1 jsonschema-4.21.0 jsonschema-specifications-2023.12.1 markdown-it-py-3.0.0 markdownify-0.11.6 mdurl-0.1.2 nats-py-2.6.0 ostorlab-0.18.18 packaging-23.2 pkgutil-resolve-name-1.3.10 proto-plus-1.23.0 protobuf-3.20.1 py-ubjson-0.16.1 pyasn1-0.5.1 pyasn1-modules-0.3.0 pygments-2.17.2 referencing-0.32.1 requests-2.31.0 rich-13.7.0 rpds-py-0.17.1 rsa-4.9 ruamel.yaml-0.18.5 ruamel.yaml.clib-0.2.8 semver-3.0.2 six-1.16.0 soupsieve-2.5 sqlalchemy-1.4.51 tenacity-8.2.3 typing-extensions-4.9.0 urllib3-2.1.0 zipp-3.17.0

[root@d0cd328d21b8 /]# ostorlab
Traceback (most recent call last):
  File "/usr/local/bin/ostorlab", line 5, in <module>
    from ostorlab import main
  File "/usr/local/lib/python3.8/site-packages/ostorlab/__init__.py", line 5, in <module>
    from ostorlab.cli.rootcli import rootcli
  File "/usr/local/lib/python3.8/site-packages/ostorlab/cli/__init__.py", line 2, in <module>
    from ostorlab.cli import scan
  File "/usr/local/lib/python3.8/site-packages/ostorlab/cli/scan/__init__.py", line 2, in <module>
    from ostorlab.cli.scan.scan import scan
  File "/usr/local/lib/python3.8/site-packages/ostorlab/cli/scan/scan.py", line 8, in <module>
    from ostorlab.runtimes import registry
  File "/usr/local/lib/python3.8/site-packages/ostorlab/runtimes/registry.py", line 4, in <module>
    from ostorlab.runtimes.local import runtime as local_runtime
  File "/usr/local/lib/python3.8/site-packages/ostorlab/runtimes/local/__init__.py", line 2, in <module>
    from .runtime import LocalRuntime
  File "/usr/local/lib/python3.8/site-packages/ostorlab/runtimes/local/runtime.py", line 31, in <module>
    from ostorlab.runtimes.local.models import models
  File "/usr/local/lib/python3.8/site-packages/ostorlab/runtimes/local/models/models.py", line 46, in <module>
    class Database:
  File "/usr/local/lib/python3.8/site-packages/ostorlab/runtimes/local/models/models.py", line 65, in Database
    exc_type: Optional[type[BaseException]],
TypeError: 'type' object is not subscriptable

Log when trying to install/run
via pip on python3.9:

Python 3.9 Install/Run Log
[root@d0cd328d21b8 /]# python3.9 -m pip install ostorlab
WARNING: Running pip install with root privileges is generally not a good idea. Try `python3.9 -m pip install --user` instead.
Collecting ostorlab
# ... lots of pip faffing about...
Successfully built nats-py
Installing collected packages: rpds-py, attrs, referencing, jsonschema-specifications, jsonschema, protobuf, certifi, charset-normalizer, idna, urllib3, requests, semver, typing-extensions, greenlet, sqlalchemy, MarkupSafe, Mako, alembic, nats-py, six, soupsieve, beautifulsoup4, markdownify, py-ubjson, packaging, docker, mdurl, markdown-it-py, pygments, rich, ruamel.yaml.clib, ruamel.yaml, tenacity, proto-plus, googleapis-common-protos, pyasn1, pyasn1-modules, cachetools, rsa, google-auth, grpcio, grpcio-status, google-api-core, google-cloud-audit-log, google-cloud-appengine-logging, grpc-google-iam-v1, google-cloud-core, google-cloud-logging, click, ostorlab
    Running setup.py install for py-ubjson ... done
ERROR: After October 2020 you may experience errors when installing or updating packages. This is because pip will change the way that it resolves dependency conflicts.

We recommend you use --use-feature=2020-resolver to test your packages with the new resolver before it becomes the default.

googleapis-common-protos 1.62.0 requires protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
grpcio-status 1.60.0 requires protobuf>=4.21.6, but you'll have protobuf 3.20.1 which is incompatible.
google-api-core 2.15.0 requires protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0.dev0,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
google-cloud-audit-log 0.2.5 requires protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
google-cloud-appengine-logging 1.4.0 requires protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
grpc-google-iam-v1 0.13.0 requires protobuf!=3.20.0,!=3.20.1,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
google-cloud-logging 3.9.0 requires protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<5.0.0dev,>=3.19.5, but you'll have protobuf 3.20.1 which is incompatible.
Successfully installed Mako-1.3.0 MarkupSafe-2.1.3 alembic-1.13.1 attrs-23.2.0 beautifulsoup4-4.12.2 cachetools-5.3.2 certifi-2023.11.17 charset-normalizer-3.3.2 click-8.1.7 docker-7.0.0 google-api-core-2.15.0 google-auth-2.26.2 google-cloud-appengine-logging-1.4.0 google-cloud-audit-log-0.2.5 google-cloud-core-2.4.1 google-cloud-logging-3.9.0 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpc-google-iam-v1-0.13.0 grpcio-1.60.0 grpcio-status-1.60.0 idna-3.6 jsonschema-4.21.0 jsonschema-specifications-2023.12.1 markdown-it-py-3.0.0 markdownify-0.11.6 mdurl-0.1.2 nats-py-2.6.0 ostorlab-0.18.18 packaging-23.2 proto-plus-1.23.0 protobuf-3.20.1 py-ubjson-0.16.1 pyasn1-0.5.1 pyasn1-modules-0.3.0 pygments-2.17.2 referencing-0.32.1 requests-2.31.0 rich-13.7.0 rpds-py-0.17.1 rsa-4.9 ruamel.yaml-0.18.5 ruamel.yaml.clib-0.2.8 semver-3.0.2 six-1.16.0 soupsieve-2.5 sqlalchemy-1.4.51 tenacity-8.2.3 typing-extensions-4.9.0 urllib3-2.1.0

[root@d0cd328d21b8 /]# ostorlab
Usage: ostorlab [OPTIONS] COMMAND [ARGS]...

  Ostorlab is an open-source project to help automate security testing.

  Ostorlab standardizes interoperability between tools in a consistent,
  scalable, and performant way.

Options:
  --version                      Show the version and exit.
  --api-key TEXT                 API key to login to the platform.
  -X, --proxy TEXT               Proxy to route HTTPS requests through.
  --tlsverify / --no-tlsverify   Control TLS server certificate verification.
  -d, --debug / --no-debug       Enable debug mode
  -v, --verbose / --no-verbose   Enable verbose mode
  --gcp-logging-credential PATH  Path to GCP logging JSON credential file.
  --help                         Show this message and exit.

Commands:
  agent    You can use agent to search, install, bootstrap and run an agent.
  auth     You can use 'auth [subcommand] [options]' to authenticate.
  ci-scan  You can use ci_scan to run scan on the CI.
  scan     Use scan [subcommand] to list, start or stop a scan.
  scanner  Ostorlab scanner enables running custom instances of scanners.
  vulnz    You can use vulnz to list and describe vulnerabilities.

I happen to be monitoring GitHub issues for a release I just put out of jsonschema an hour or two ago, so just because I see this PR, in case it's helpful:

I figured out that some of the transitive requirements (jsonschema, semver) require python 3.9+.

jsonschema is 3.8+ not 3.9+. I do generally try to maintain support for all non-EOL Python versions (so 3.8 will definitely drop when 3.8 is EOLed, though possibly before if some major impediment comes up). And older releases of course support versions regardless of when they're dropped, so no end users should really have to worry about this.
(Again I didn't look at the rest of the PR, so feel free to ignore if unhelpful.)

Thanks, @distortedsignal for making it clearer for the next users.
Kudos @Julian for your support and hard work. Really appreciated.


DBeaver: SQL Assist for SQL Server is even more broken in DBeaver 5.2.5

DBeaver - Version 5.2.5 CE
DBeaver JDBC driver: Microsoft
Operating System: Windows 7 / Windows 8.1 / Windows 10
Database Server: Microsoft SQL Express 2014
Seems the SQL Assist functionality is even more broken now with the release of DBeaver 5.2.5.
In DBeaver 5.2.4 (almost OK)
o Set global property: Database -> Editors -> SQL Completion -> Enable auto activate = false.
o Start a SQL Editor.
o Write the SQL command "SELECT * FROM Pat" (we have a table called "Patients".
o Press Ctrl+Space for SQL Assist.
o The suggested table name become "Patiens" - OK.

The reason it is "almost OK" is that I can not have the "Enable auto activate = true". That has only worked when I connect to a PostgreSQL database, never a SQL Server. See my issue #2226.
In DBeaver 5.2.5 (not OK at all)
o Set global property: Database -> Editors -> SQL Completion -> Enable auto activate = false.
o Start a SQL Editor.
o Write the SQL command "SELECT * FROM Pat" (we have a table called "Patients".
o Press Ctrl+Space for SQL Assist.
o The suggested table name become "PATH" - ERROR.

If I write the schema prefix "dbo." then the SQL Assist works better.
o Set global property: Database -> Editors -> SQL Completion -> Enable auto activate = false.
o Start a SQL Editor.
o Write the SQL command "SELECT * FROM dbo.Pat" (we have a table called "Patients".
o Press Ctrl+Space for SQL Assist.
o The suggested table name become "dbo.Patients" - OK.

I really don't want to have to write the schema prefix "dbo." since that is the default database schema.
PS. Noticed that this issue is kind of like the issue #4635.

Mostly duplicate of #4635 (see comments for workaround).


[Java] Upgrade service documents from Track 1 to Track 2

80% documents on Docs should be updated

Document that needs to be updated: https://microsoftapc-my.sharepoint.com/:x:/g/personal/haolingdong_microsoft_com/Ed1Dh8cKlf9Gq_URq_QfDK8B2X4V-j3NqvKwBXIMav7KDQ?e=nSyCqp


feat: provide nixpkgs overlay in flake

This PR adds on to the work in #32, providing an overlay that can be added to a nixpkgs set. Passing a grammar into tree-sitter's extraGrammars argument is typically what most NixOS users would want to do, so that editors like Emacs can use those grammars. This makes consuming the repo in a flake-based NixOS config very easy, by simply including inputs.astro-tree-sitter.overlays.default in the nixpkgs set's overlays.

Thanks for the PR!


stable tag not in https://github.com/qurator-spk/my_ocrd_workflow

Need to push the tags to https://github.com/qurator-spk/my_ocrd_workflow

Since 67994d1, https://github.com/mikegerber/my_ocrd_workflow/blob/master/README-DEV.md now mentions pushing the tags to https://github.com/qurator-spk/my_ocrd_workflow.


Elementum is crashing when trying to Add Torrent

When I'm trying to add a torrent from a file, and starting to navigate through the file source, elementum crashes. Using Kodi 20

Same issue on my side with Kodi 20
Attached log below
kodi.old.log

Yes, it seems it only happens on Android ARM64.
I have a stick tv Android ARM and it works perfectly.

It can be caused by libtorrent library and the system calls it does when adding torrent.

Btw, can you select Android Arm architecture, instead of automatic selection (that selects arm64)? Then restart Kodi and check again the issue.

@icarok99 Can you show the log when you run with Android Arm architecture selected?

@elgatito Kodi log

@icarok99 You log is saying you are running android_arm64 platform, and not android_arm.

This problem only happens Android_arm64

On my other device which is Android_arm it is working normally

@elgatito Problem solved with this new update, and thank you very much elgatito.

Great to hear. Closing the issue.


Could not receive a message from the daemon.

Hi, first of all I am new at flutter and when i try to use Android Emulator at Android Studio I am getting this error:
Running Gradle task 'assembleDebug'...
FAILURE: Build failed with an exception.

What went wrong:
Could not receive a message from the daemon.

Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

Get more help at https://help.gradle.org
Exception: Gradle task assembleDebug failed with exit code 1

But when i choose "Profile or debug APK" and open an APK my Android Emulator works without problem. I uninstalled and redownloaded Android Studio, deleted everything about it even redownloaded flutter, tried using different versions of gradle too but nothing changed. Tried using Visual studio code too but getting same error.
I would be very glad if anyone could help.

If you're on windows 10 desable Wi-Fi Hotspot, it's some Network Interface issue!

If you're on windows 10 desable Wi-Fi Hotspot, it's some Network Interface issue!

thank you very much. This solve my problem with react-native (win10)

I also disabled the Hotspot and it works. Thanks

If you're on windows 10 desable Wi-Fi Hotspot, it's some Network Interface issue!

Just what I needed, thank you!

Was having the same problem but without hotspot, fixed it by forcing IPv4, more disscusing and my solution in this issue: #14094

@jjohannes By the discussion on #14094 this is a Gradle issue introduced in 6.4.1.
A workaround for this is disabling WIndows 10 Hotspot if you have it enabled or (if you don't have it enabled or need it) setting a System Enviroment Variable for Java with the name _JAVA_OPTIONS and value -Djava.net.preferIPv4Stack=true to prefer IPv4 usage.

Thanks for clarifying @SuporteSysrs01. I am sure this will help a lot of folks. I guess #14094 is enough to track this on the Gradle side?

if anyone using Vmware, check this.
https://stackoverflow.com/a/69371251/13122560
gl.

Thank you very much!

@0eN are there any other solutions other than disabling Wi-Fi Hotspot on the emulator? I tried but it doesn't fix it!

If you're on windows 10 desable Wi-Fi Hotspot, it's some Network Interface issue!

thanks alot it works!!

If you're on windows 10 desable Wi-Fi Hotspot, it's some Network Interface issue!
Thank you very much!


More Questions

I use the below method to handle UTC offset. I haven't fully grasped your architecture yet, where should I implement the below?

    def daylight_savings(utc, march, november): # daylight_savings(utc=(2020, 4, 9, 8, 44, 4, 4, 362, 0), march=-7 november=-8)
        year = time.localtime(utc)[0]  # get current year
        now = time.time()
        local_time = None
        HHMarch = time.mktime(
            (year, 3, (14-(int(5*year/4+1)) % 7), 1, 0, 0, 0, 0, 0))  # Time of 2nd Sunday of March change to PDT
        HHNovember = time.mktime(
            (year, 11, (7-(int(5*year/4+1)) % 7), 1, 0, 0, 0, 0, 0))  # Time of 1st Sunday of November change to PST
        if now < HHMarch:  # we are before last sunday of march
            local_time = now + 3600 * november
            pac = time.localtime(local_time)  # PDT:  UTC-8H
        elif now < HHNovember:  # we are before last sunday of october
            local_time = now + 3600 * march
            pac = time.localtime(local_time)  # PST: UTC-7H
        else:  # we are after last sunday of october
            local_time = now + 3600 * november
            pac = time.localtime(local_time)  # PDT:  UTC-8H
        return local_time

I am in the US so I need to convert C to F

    def celsius_to_fahrenheit(c):
        n = float(9.0 / 5.0 * c + 32)
        # self.dprint("Temp: {}".format(str(n)))
        # normal_round
        if n - math.floor(n) < 0.5:
            return math.floor(n)
        return math.ceil(n)

The time sync is done in: https://github.com/kevinkk525/pysmartnode/blob/master/pysmartnode/networking/wifi_esp32.py (if you use the esp32).
Conversion from C to F is a good point.. I don't have anything implemented to allow using Fahrenheit instead of Celsius. I should probably do that for temperature sensors.


can't get video formats from redtube

hi, i find the package is not working well with redtube and tube
var ytdl = require('youtube-dl');
var url = 'http://www.redtube.com/1538723';

ytdl.getInfo(url, function(err, info) {

  'use strict';
  if (err) { throw err; }

  console.log('id:', info.id);
  console.log('title:', info.title);
  console.log('url:', info.url);
  console.log('thumbnail:', info.thumbnail);
  console.log('description:', info.description);
  console.log('filename:', info._filename);
  console.log('duration:', info.duration);
  console.log('format_id:', info.format_id);
  console.log(info.formats);
});

output:
id: 1538723
title: Sensual hardcore seduction very young teen
url: http://vida.lsw.hd.redtubefiles.com/videos/0001538/_hd/1538723.mp4?st=VFovN0nun6va2d2SBR2b5w&e=1461418121&rs=151&ri=1400
thumbnail: http://thumbs.cdn.redtube.com/media/videos/0001538/1538723/thumbs/1538723_012m.jpg
description: undefined
filename: Sensual hardcore seduction very young teen-1538723.mp4
duration: NaN
format_id: 0
undefined

I also find it doesn't work well with xtube.com, like http://www.xtube.com/video-watch/Fist-till-he-drips-28137011
please fix the bug.
thanks

@wdfsinap please post the whole output; add -v flag to your command line you run youtube-dl it should look similar to one below:
$ youtube-dl -v <your command line>
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2016.05.01
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

MacBook-Air:~ will$ youtube-dl -v http://www.redtube.com/1538723 --dump-json
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.redtube.com/1538723', u'--dump-json']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.05.01
[debug] Python version 2.7.9 - Darwin-14.0.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.5.2, ffprobe 2.5.2, rtmpdump 2.4
[debug] Proxy map: {}
{"display_id": "1538723", "extractor": "RedTube", "protocol": "http", "format": "0 - unknown", "requested_subtitles": null, "format_id": "0", "id": "1538723", "playlist": null, "thumbnails": [{"url": "http://thumbs.cdn.redtube.com/media/videos/0001538/1538723/thumbs/1538723_012m.jpg", "id": "0"}], "http_headers": {"Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)"}, "url": "http://vida.lsw.hd.redtubefiles.com/videos/0001538/_hd/1538723.mp4?st=2jZjklRojLyRPGs6PKMlew&e=1462395265&rs=151&ri=1400", "extractor_key": "RedTube", "title": "Sensual hardcore seduction very young teen", "playlist_index": null, "ext": "mp4", "webpage_url": "http://www.redtube.com/1538723", "_filename": "Sensual hardcore seduction very young teen-1538723.mp4", "fulltitle": "Sensual hardcore seduction very young teen", "age_limit": 18, "thumbnail": "http://thumbs.cdn.redtube.com/media/videos/0001538/1538723/thumbs/1538723_012m.jpg", "webpage_url_basename": "1538723"}

*tube does not provide information in their webpages hence it's not available in the feeds.


recv block

I encountered a problem with recv blocking while setting the redisConnectWithTimeout function.
version：1.1.0
Stack Information：

It seems similar to https://github.com/redis/redis/issues/9956.


Improvement Request

Can we just return the content_object as the data?
This is an example:
class SearchBookListView(ListView):
    model = get_vectordb_model()
    template_name = 'library/search.html'

    def get_queryset(self):
        q = self.request.GET.get("q")
        return vectordb.search(q, k=10)

I re-use the template accross multiple types of search all using book.title to display the title (as an example).
Right now I have to resort to chenanigans like:
{% for book in page_obj %}
            {% if book.content_object %}
                {% include 'library/partials/book_card/horizontal.html' with book=book.content_object %}
            {% else %}
                {% include 'library/partials/book_card/horizontal.html' with book=book %}
            {% endif %}
    {% endfor %}

With vector search, the book data is accessed in book.content_object not book. Returning the metadata right away with the _state as a field would be much better.

I understand your frustration. A possible solution is to add an optional argument for the content object type. If this argument is given, the function could return the queryset of those content objects. This is because the API can store any kind of object, including plain text. I think this would make the return type more clear and consistent. Does this sound good to you?

I've implemented a solution for this in version 0.2.0. Now, you can easily unwrap all model instances from any vectordb queryset.
Take the example you provided:
class SearchBookListView(ListView):
    model = get_vectordb_model()
    template_name = 'library/search.html'

    def get_queryset(self):
        q = self.request.GET.get("q")
        return vectordb.search(q, k=10)

With the new update, you can modify it like this to directly get the Book instances:
class SearchBookListView(ListView):
    # skip
     ....

    def get_queryset(self):
        q = self.request.GET.get("q")
        return vectordb.search(q, k=10).unwrap()

Using unwrap will return all the model instances matching your query. If your vectordb contains different types of objects, the best approach is to specify a content_type, a feature introduced in version 0.2.0. To ensure you only get Book instances, you can use the content_type argument. This can be a string like Book or <app_label>.Book, or you can directly provide the class itself. For example:
return vectordb.search(q, k=10, content_type=Book).unwrap()

The above method is recommended for unwrapping objects because it allows you to postpone unwrapping until you are completely done using the queryset. If you prefer the search function to automatically unwrap the results for you, you can do so by setting unwrap=True:
return vectordb.search(q, k=10, content_type=Book, unwrap=True)

I'll be adding official documentation for these features shortly.


Populate session id unconditionally

Description
Please explain the changes you made here.
Release notes
The title of the pull request will be used as the default release notes description. If more detail is needed to communicate to partners the scope of the PR's changes, use this release notes section.
Checklist
General
Read the full guidelines for PRs here

[ ] Added the correct label: < feature | bug | dependencies | infrastructure | ignore-for-release | database >
[ ] Created unit and/or browser tests which fail without the change (if possible)
[ ] Performed manual testing (Chrome and Firefox if it includes front-end changes)
[ ] Extended the README / documentation, if necessary

User visible changes

[ ] Followed steps to internationalize new strings
[ ] Wrote browser tests using the validateAccessibility method
[ ] Tested on mobile view. See mobile device mode
[ ] Manually tested at 200% size
[ ] Manually evaluated tab order

New Features

[ ] Add new FeatureFlag env vars to server/conf/helper/feature-flags.conf
[ ] Conditioned new functionality on a FeatureFlag
[ ] Wrote browser tests with the feature flag off and on, etc.

Instructions for manual testing
If instructions are needed for manual testing by reviewers, include them here.
Issue(s) this completes
Fixes #<issue_number>; Fixes #<issue_number>...

Current dependencies on/for this PR:

main

PR #5832

PR #5896   👈
PR #5851

PR #5730

PR #5731

PR #5816

This stack of pull requests is managed by Graphite.

Current dependencies on/for this PR:

main

PR #5832

PR #5896   👈
PR #5851

PR #5730

PR #5731

PR #5816

This stack of pull requests is managed by Graphite.

Merge activity

Nov 14, 9:22 PM: Graphite rebased this pull request after merging its parent, because this pull request is set to merge when ready.


TypeError: self.response.abort is not a function

The code to generate the error :
request("http://migre.me/sgP5Z", function (error, response, body) {
})

After some investigation I found that the redirection generate a bad URI :
Url {
  protocol: 'http:',
  slashes: true,
  auth: null,
  host: '',
  port: null,
  hostname: '',
  hash: null,
  search: null,
  query: null,
  pathname: '//iusnatura.com.br/meio-ambiente/cop-21-pode-resultar-em-acordo-historico-para-conter-aquecimento-global/%27',
  path: '//iusnatura.com.br/meio-ambiente/cop-21-pode-resultar-em-acordo-historico-para-conter-aquecimento-global/%27',
  href: 'http:////iusnatura.com.br/meio-ambiente/cop-21-pode-resultar-em-acordo-historico-para-conter-aquecimento-global/%27' }

Any idea to avoid this issue ?
Thanks

This is how the request looks like:
{ request:
   { debugId: 1,
     uri: 'http://migre.me/sgP5Z',
     method: 'GET',
     headers: { host: 'migre.me' } } }
{ redirect:
   { debugId: 1,
     statusCode: 301,
     headers:
      { date: 'Wed, 09 Dec 2015 15:20:35 GMT',
        server: 'Apache/2.2.14 (Ubuntu)',
        'x-powered-by': 'PHP/5.3.2-1ubuntu4.30',
        'set-cookie': [Object],
        location: 'http:////iusnatura.com.br/meio-ambiente/cop-21-pode-resultar-em-acordo-historico-para-conter-aquecimento-global/',
        connection: 'close',
        'content-length': '0',
        vary: 'Accept-Encoding',
        'content-type': 'text/html; charset=utf-8' },
     uri: 'http:////iusnatura.com.br/meio-ambiente/cop-21-pode-resultar-em-acordo-historico-para-conter-aquecimento-global/' } }

So it seems they have and extra pair of // in their location header. It's obviously a server issue and request is not that fault tolerant.

Thanks for your answer.
Any idea to "catch" the error ?
BR

request("http://migre.me/sgP5Z", function (error, response, body) {

})
.on('error', function (err) {
  console.log(err)
})

But currently there is a bug in request as well. I just pushed a fix here: https://github.com/request/request/pull/1958

Thanks but with theses method "on('error'" don't catch the error. I will apply the patch.


Migrating repository to xarray-contrib

As suggested here by @dcherian there's the option to add xeofs to xarray-contrib. Besides increased visibility, this could potentially attract more people willing to contribute to the further development of xeofs.
Do you have any objections to migrating xeofs to xarray-contrib, @slevang or are you in agreement with this?

Yeah sounds good to me!

Opened an issue over in xarray-contrib.


Fix gas estimations method

Right now gas estimation is done with max value per gas big which prevents sometimes gas estimation.
Probably we have to do it twice, or maybe not.

fixed


Add docs on well-known event providers

Summary
This is a documentation on some of the well-known event providers in .NET.
Contributes to:

https://github.com/dotnet/diagnostics/issues/515
https://github.com/dotnet/diagnostics/issues/567

This PR number reminds me of a cute poem 🏇
1 1 was a racehorse.
2 2 was 1 2.
2 2 1 1 race.
2 2 1 1 2.


Fixed a typo

Fixed a type in the command name "Edit profile". It was "Edite profile", so I decided to change it to a proper form. There are some cosmetic changes (basically spaces and tabs here and there) that came from me using an autoformatter, but they don't seem to be too aggressive and are quite helpful. I've tested the extension and it works as expected.

Hi, thanks for improving the extension!
I have checked the PR and will publish it in version 1.0.7


Residual problem with graphics module

I'm afraid issue #332 was closed prematurely.   Well, the main issue was resolved but the original reason I reported the issue was not resolved.  Our graphics tutorial is broken for the section discussing SeismogramEnsemble plots.
The problem was we didn't close on an inconsistency between what I had locally to resolve the issue and what was actually implemented.   In our C++ code base is the a function called EnsembleComponent.   It behaves exactly the same as a related function called ExtractComponent in ccore.  Both extract a single component of data from 3C data.  The difference is one is for ensembles and the other atomic Seismogram objects.   #332 resolved this problem by creating a python wrapper called ExtractComponent that handles type mistmatches the pythonic way.  It uses a set of isinstance calls to deal with strong typing inputs from ccore.
The first order problem that happened is we didn't fix graphics.py to match this change.  The current graphics.py module has the following import lines:
from mspasspy.ccore.algorithms.basic import ExtractComponent, EnsembleComponent
from mspasspy.algorithms.window import scale as alg_scale

Those lines resolve but the first line should be this:
from mspasspy.algorithms.basic import ExtractComponent

That, however, leaves unresolved references to EnsembleComponent.   There are six in the graphics.py and they can be fixed in 30 s with a global change all EnsembleComponent  to ExtractComponent.
We need apply that patch asap as the graphics tutorial is broken until we fix it.  The way the fix can be tested is simple:  just run the graphics tutorial and see if it works.
Had I known how to do so I'd have just edited that file on github to make that fix, but think preserving this for the record is important anyway.   The reason is that I think there is some additional cleanup we should do with this.

Having a ccore function and a python function with the exact same signature but different behavior is a bad bad idea.  Step 1 is to change the pybind11 code to define the ccore version to be _ExtractComponent.
A tougher decision is what to do about the function now called EnsembleComponent in ccore?   Right now the wrapper code for ExtractEnsemble to handle this is a little weird and hence confusing:

    if isinstance(data, Seismogram):
        try:
            d = bsc.ExtractComponent(data, component)
            return d
        except Exception as err:
            data.elog.log_error("ExtractComponent", str(err), ErrorSeverity.Invalid)
            empty = TimeSeries()
            empty.load_history(data)
            empty.kill()
            return empty
    elif isinstance(data, SeismogramEnsemble):
        if data.dead():
            empty = TimeSeriesEnsemble()
            empty.elog = data.elog
            empty.kill()
            return empty
        try:
            d = TimeSeriesEnsemble(bsc.EnsembleComponent(data, component))
            return d
        except Exception as err:
            logging_helper.ensemble_error(
                data, "ExtractComponent", err, ErrorSeverity.Invalid
            )
            empty = TimeSeriesEnsemble()
            empty.elog = data.elog
            empty.kill()
            return empty

The confusing of using the bsc qualifier for both Seismogram and SeismogramEnsemble sections could be eliminated if we first fix the pybind 11 wrappers as noted above.   The weirder construct is:
d = TimeSeriesEnsemble(bsc.EnsembleComponent(data, component))

That line, at least, screams for a comment to explain why the secondary copy is needed.   That should probably be done, by the way, for the initial patch for this problem.   The BROADER PROBLEM this illustrates, however, is something discussed previously in #332.   We need to clean up the handling of Ensembles.  The fundamental issue is during the evolution of ensembles we extended the original ccore Ensemble templates to define a a set of LoggingEnsemble templates.   The later added elog.   For consistency with our atomic data objects we really should go through the C++ code base and change a occurences of Ensemble to CoreEnsemble.   That change could be isolated in the C++ code by having the pybind11 code handle CoreEnsemble in the same way we now handle CoreTimeSeries and CoreSeismogram.  That is, those symbols are treated as private with appropriate use of "_" to clarify the namespace (i.e. in python the a C++ CoreTimeSeries would only be visible as _CoreTimeSeries and a Seismogram would only be visible as _CoreSeismogram).
The second part of this proposed fix is not critical, BUT it is better to do it now than later.  The longer we delay the more confusion it will create.  It will definitely create a long-term maintenance issue if we don't deal with it.

A not so small postscript to the previous.  In trying to get graphics to work I came to realize we had some additional unresolved issues with graphics.py.   There is a sizing problem that happens somehow with the imageplot version.   Whoever gets assigned the task of fixing the above might want to look for other issues in graphcs.py.  There are two I know of:

As noted the imageplot scaling is not working right with plots of small number so things.  I think there is a bug in the aspect ratio calculation I'm not finding.
The much more difficult issue to fix is an inconsistency in how the class handles pyplot handles.    I particularly note this method that always returns an array of pyplot handles:

    def _wtva_SeismogramEnsemble(self, d, fill):
        # implement by call to ExtractComponent and calling TimeSeriesEnsemble method 3 times
        # should return a list of 3 gcf handles
        figure_handles = []
        for k in range(3):
            dcomp = ExtractComponent(d, k)
            # figure_title='Component %d' % k
            # pyplot.figure(figure_title)
            pyplot.figure(k)
            handle = self._wtva(dcomp)
            figure_handles.append(handle)
        # pyplot.show()
        return figure_handles

When that private method is called internally, however, it is handled this way:
if isinstance(d, SeismogramEnsemble):
            if len(d.member) <= 0:
                raise IndexError(base_error + "ensemble container is empty")
            self._wtva_SeismogramEnsemble(d, fill)
            self._add_3C_titles()

which means the handles are just dropped.
The fundamental issue is when I wrote this code I had planned ahead by trying to have the code return the plot handles.  That could and should be a simple way to write an extension class of SeismicPlotter that had enhanced features.   I obviously never tested that I did all that right.  The basic message is we need to have both the classes in this file updated to consistently handle returns of pyplot handles from any plot.

Let me add to the comment above about changing the name Ensemble in the C++ code base everywhere to CoreEnsemble.   There is a bit more to this than just one name change.

For consistency with atomic data objects we should ALSO change LoggingEnsemble to Ensemble.  Then an Ensemble relative to CoreEnsemble is like TimeSeries is to CoreTimeSeries.
The current layout has a mismatch with the atomic data we should fix.  Specifically, the live/dead concept is currently implemented in LoggingEnsemble.   Implementation of the live/dead concept should be in the base class for consistency with TimeSeries and Seismogram.

There is a residual, much thornier issue that would benefit from discussion before we proceed: ProcessingHistory.  The TimeSeries and Seismogram objects inherit a ProcessingHistory object (the assumption is a TimeSeries, for example, "is a" ProcessingHistory" instead "has a" ProcessingHistory.   That is particularly problematic because most people would say "has a" is a better answer than "is a".   I take responsibility for that design decision because back about 2 years ago I had some issue I couldn't resolve doing that and decided to define it as "is a".  In retrospect that was a bad idea, but in my view it would be way way to hard to back that out now as it would break a lot of things.
What this raises is if we should add a ProcessingHistory to the data formerly known as LoggingEnsemble for consistency with the atomic data?  If the answer is yes we'd have to address the "is a" or "has a" question again, but I assert we should not include PrecessingHistory in the revised Ensemble==LoggingEnsemble.   There is a fundamental reason:  An ensemble will break the constraints in the design of ProcessingHistory.   The reason is deeply in the weeds of the implementation.   A simple summary is that the ProcessingHistory container assumes a tree structure that is limited to map-reduce.   That is, the nodes of the tree are defined by a processing step and the tree is inverted meaning it begins with the leaves and terminates at the root.   If an ensemble appeared in the middle of a chain the tree could grow both ways and I am pretty sure the implementation will not handle that situation.  Hence, I think we should continue to take the position that only Seismogram and TimeSeries are atomic and ensembles are a different thing.  Note, this issue will carry over to our under construction ArrayEnsemble (or whatever we call it too.   I personally don't think the interest or need for processing history as a concept is worth the investment it would take to retrofit the entire code base to handle ensembles.   @wangyinz please rule on this question for the record.
If you accept my plan above I suggest we address this issue in two steps:

We continue, as decided in yesterday, to first apply the patch to graphics.py I described in the first box of this issue page.
When the patch is done the job of fixing the C++ code base is likely best done by me (@pavlis).  Fortunately, we can insulate the python code base from this fix as the pybind11 code can and already does alias the C++ names.   i.e. I am 100% sure we can make a TimeSeriesEnsemble and SeismogramEnsemble 100% backward compatible with existing python code.

This secondary copy is redundant.
d = TimeSeriesEnsemble(bsc.EnsembleComponent(data, component))

Using this can also work:
d = bsc.EnsembleComponent(data, component)

I will replace it in the code.


Predict and auto-pin tabs based bases on my pin history

When ever I pin a tab, train Google Prediction API with the title of the pinned tab. Add a new option which allows tabwrangler to auto-pin tabs.
Once you have a history of atleast 100 pinned tabs, each time a tab is opened and not closed by the user after set time, then instead of directly closing the tab, tab wrangler will ask prediction api if the title of the tab is a match. And the tab is automatically pinned if prediction api gives a go.
For each autopinned tab, user should be able to mark if the autopin was helpful and this feedback should be used to further train the prediction api.
The prediction and training set should be on a per user basis (obviously).
Resources: https://developers.google.com/prediction/

This does sound cool, but I agree this is beyond the scope of Tab Wrangler for the time being. I'm happy to look at any pull requests though.


'lxml.etree._Element' object has no attribute 'pPr'

I'm trying to read this file: diary.docx, and getting AttributeError on line 56 of paragraph style
I tried to print different variables and num_style inside get_paragraph_ind is being returned as NoneType by the function get_num_style even when the p.pPr value is not null so most probably it's not able to find any subElement for abstractNumbering
Will be great if someone can help me resolve this 🙏
I've attached the docx file I'm using and a screenshot of the Error message below:

forgot to add my code snippet, adding it here
import docx
from simplify_docx import simplify

doc = docx.Document("/Users/lavishsaluja/Downloads/diary.docx")

json_doc = simplify(doc)

Can confirm this issue is happening to me as well
OS: Mac Catalina 10.15.5
Word Version: 16.16.25
Steps to replicate:

Create a new document in Word
Add numbering to any paragraph
Save document
(example attached)
Sample Document.docx

Issue seems to start here: https://github.com/microsoft/Simplify-Docx/blob/ce493b60e3e4308bde7399257426c0c68a6c699b/src/simplify_docx/utils/paragrapy_style.py#L54
In particular, it seems that although
num_style is not None,
the element doesn't have a pPr attribute.
If you bypass:
https://github.com/microsoft/Simplify-Docx/blob/ce493b60e3e4308bde7399257426c0c68a6c699b/src/simplify_docx/utils/paragrapy_style.py#L55-L58
(e.g.)
    if num_style is not None:
        try:
            if num_style.pPr is not None and \
            num_style.pPr.ind is not None:
                return num_style.pPr.ind
        except AttributeError:
            return None

Then the script runs without error, although style-related information doesn't get pulled in...

hi, this is still happening to me, can i know if theres something im doing wrongly?


feat: add Project Portal appbundle proxy

Description

[ ] PR title and description are to the point and understandable
[ ] I have performed a self-review of my own code'

Please select version type the purposed change:

[ ] major
[ ] minor
[ ] patch
[ ] none

External Relations

[ ] database migration

Changeset

Will be resolved by #802


Live Future Option Chain Provider Failing

Expected Behavior

Live Future Option Chain Provider works correctly

Actual Behavior

See LiveOptionChainProviderReturnsFutureOptionData unit test which calls LiveOptionChainProvider failing due to forbidden error code

Potential Solution

Review failure reason and potential solution

Reproducing the Problem

N/A
System Information

N/A
Checklist

[x] I have completely filled out this template
[x] I have confirmed that this issue exists on the current master branch
[x] I have confirmed that this is not a duplicate issue by searching issues

[x] I have provided detailed steps to reproduce the issue

Closing issue for now, seems to have been a temporary issue

Reopening this issue since it's been happening for a few days already


Crashing when import m3u playlist

Crashing when import m3u playlist, also app  not fetching m3u playlist remotely .
can i contact you ,i need some custom work in this app?

Remote isn't implemented yet.


Added Visual Studio Test Agent 2019 version 16.11.9.

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

@ItzLevvie Are you sure these are correct?

cc @Trenly: Yes they are.
Most of the VS packages install the latest one instead of the version specific one.

@ItzLevvie Are you sure these are correct?

cc @Trenly: Yes they are.
Most of the VS packages install the latest one instead of the version specific one.

Ahhh, the PR Title just got to me; Ty


fix debug arg

Fixes #509

That's a lot of failed checks for a 3 line change

@yonnorc42 Thanks.  I'm fixing the pylint issues in #508 so I'll merge this once I fix stuff there.


RFE: Central collection point for results

Add a feature to tag workload results and upload them to a central repository (likely an object store). Could be configurable as a private repo, or could default to a public one where we can collect broad result sets for analysis.

I am re-iterating on this idea.
Current idea:
Create shared pvc deploy/result-pvc.yaml
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
   name: result-volume
spec:
   accessModes:
     - ReadWriteMany
   resources:
     requests:
       storage: 1Gi

Since we are moving to template our workloads, this would be simple to implement...
---

apiVersion: batch/v1
kind: "job"
metadata:
  name: "{{ meta.name }}-sysbench"
  namespace: "{{ meta.namespace }}"
spec:
  ttlSecondsAfterFinished: 600
  template:
    metadata:
      labels:
       app: sysbench
    spec:
      containers:
      - name: sysbench
        command: ["/bin/sh", "-c"]
        args: ["/tmp/sysbenchScript"]
        image: "docker.io/smalleni/centos-sysbench:latest"
        volumeMounts:
        - name: sysbench-volume
          mountPath: "/tmp/"
{% if store_results %}
        - name: result-data
          mountPath: "{{results.path}}"
{% endif %}
      volumes:
      - name: sysbench-volume
        configMap:
          name: "{{ meta.name }}-sysbench-config"
          defaultMode: 0777
{% if store_results %}
      - name: result-data
        persistentVolumeClaim:
          claimName: result-volume
{% endif %}
      restartPolicy: OnFailure

The output needs to be sent to the share location
Again, modifying the template roles/sysbench/templates/sysbench.sh.j2
...
sysbench --test={{test.name}} \
  {% for opt,value in test.parameters.iteritems() %}
  --{{opt}}={{value}} \
  {% endfor %}
  run {% if store_results %} \
  | tee {{results.path}}/stdout {% endif %}
...

To enable this feature, it is in our CR
  store_results: true
  results:
    path: /opt/results/

This just gets the Operator to wearhouse the data... Next step is to add a elasticsearch connector and index the data... Create a parser, etc.

Looks good, Added a comment inline

I am re-iterating on this idea.
Current idea:
Create shared pvc deploy/result-pvc.yaml
---
kind: PersistentVolumeClaim
apiVersion: v1
metadata:
   name: result-volume
spec:
   accessModes:
     - ReadWriteMany
   resources:
     requests:
       storage: 1Gi

Since we are moving to template our workloads, this would be simple to implement...
---

apiVersion: batch/v1
kind: "job"
metadata:
  name: "{{ meta.name }}-sysbench"
  namespace: "{{ meta.namespace }}"
spec:
  ttlSecondsAfterFinished: 600
  template:
    metadata:
      labels:
       app: sysbench
    spec:
      containers:
      - name: sysbench
        command: ["/bin/sh", "-c"]
        args: ["/tmp/sysbenchScript"]
        image: "docker.io/smalleni/centos-sysbench:latest"
        volumeMounts:
        - name: sysbench-volume
          mountPath: "/tmp/"
{% if store_results %}
        - name: result-data
          mountPath: "{{results.path}}"
{% endif %}
      volumes:
      - name: sysbench-volume
        configMap:
          name: "{{ meta.name }}-sysbench-config"
          defaultMode: 0777
{% if store_results %}
      - name: result-data
        persistentVolumeClaim:
          claimName: result-volume
{% endif %}
      restartPolicy: OnFailure

The output needs to be sent to the share location
Again, modifying the template roles/sysbench/templates/sysbench.sh.j2
...
sysbench --test={{test.name}} \
  {% for opt,value in test.parameters.iteritems() %}
  --{{opt}}={{value}} \
  {% endfor %}
  run {% if store_results %} \
  | tee {{results.path}}/stdout {% endif %}

Instead of just using a file stdout, perhaps append timestamp it to file name after benchmark name so something like sysbench_1554321422.stdout

...
To enable this feature, it is in our CR

store_results: true
results:
path: /opt/results/
This just gets the Operator to wearhouse the data... Next step is to add a elasticsearch connector and index the data... Create a parser, etc.


Example script fails to connect

gdax-tt 0.1.16
node 8.3.0
typescript 2.5.3
Script pulled from example doc https://coinbase.github.io/gdax-tt/gtt_tutorials_feed.html#the-basics
import * as GTT from "gdax-trading-toolkit";
import { GDAXFeed } from "gdax-trading-toolkit/build/src/exchanges";
import { OrderbookMessage } from "gdax-trading-toolkit/build/src/core";

const logger = GTT.utils.ConsoleLoggerFactory();
const products: string[] = ["BTC-USD", "ETH-USD", "LTC-USD"];
const tallies: any = {};
products.forEach((product: string) => {
  tallies[product] = {};
});

let count = 0;

function printTallies() {}

GTT.Factories.GDAX
  .FeedFactory(logger, products)
  .then((feed: GDAXFeed) => {
    feed.on("data", (msg: OrderbookMessage) => {
      count++;
      if (!(msg as any).productId) {
        tallies.other += 1;
      } else {
        const tally = tallies[msg.productId];
        if (!tally[msg.type]) {
          tally[msg.type] = 0;
        }
        tally[msg.type] += 1;
      }
      if (count % 1000 === 0) {
        printTallies();
      }
    });
  })
  .catch((err: Error) => {
    logger.log("error", err.message);
    process.exit(1);
  });

Logs
2017-10-01T05:12:52.329Z - info: Creating new Websocket connection to wss://ws-feed.gdax.com
2017-10-01T05:12:52.340Z - debug: Reconnecting to wss://ws-feed.gdax.com  in 0 seconds...
2017-10-01T05:12:52.340Z - debug: Closing existing socket prior to reconnecting to wss://ws-feed.gdax.com
2017-10-01T05:12:53.693Z - debug: Connection to wss://ws-feed.gdax.com  has been established.
2017-10-01T05:12:53.693Z - debug: Sending {"type":"subscribe","product_ids":["BTC-USD","ETH-USD","LTC-USD"],"channels":["level2","matches","ticker","user","heartbeat"]} message to WS server

/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Sender.js:206
      bufferUtil.mask(data, mask, outputBuffer, dataOffset, dataLength);
                ^
TypeError: Cannot read property 'mask' of undefined
    at Sender.frameAndSend (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Sender.js:206:17)
    at /app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Sender.js:126:12
    at /app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/PerMessageDeflate.js:313:5
    at afterWrite (_stream_writable.js:438:3)
    at onwrite (_stream_writable.js:429:7)
    at DeflateRaw.afterTransform (_stream_transform.js:90:3)
    at Zlib.callback (zlib.js:514:5)

Similar behavior when trying to use the Bitfinex feed
Logs
2017-10-01T05:16:17.082Z - info: Creating new Websocket connection to wss://api2.bitfinex.com:3000/ws
2017-10-01T05:16:17.694Z - debug: Connection to wss://api2.bitfinex.com:3000/ws  has been established.
2017-10-01T05:16:17.694Z - debug: Sending {"event":"subscribe","channel":"ticker","pair":"btcusd"} message to WS server
2017-10-01T05:16:17.695Z - debug: Sending {"event":"subscribe","channel":"trades","pair":"btcusd"} message to WS server
2017-10-01T05:16:17.695Z - debug: Sending {"event":"subscribe","freq":"F0","channel":"book","pair":"btcusd","len":"250"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","channel":"ticker","pair":"ethusd"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","channel":"trades","pair":"ethusd"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","freq":"F0","channel":"book","pair":"ethusd","len":"250"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","channel":"ticker","pair":"ltcusd"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","channel":"trades","pair":"ltcusd"} message to WS server
2017-10-01T05:16:17.696Z - debug: Sending {"event":"subscribe","freq":"F0","channel":"book","pair":"ltcusd","len":"250"} message to WS server

/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:371
    callback(null, messageBuffer);
    ^
TypeError: Cannot read property 'isValidUTF8' of undefined
    at /app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:532:28
    at Receiver.applyExtensions (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:371:5)
    at /app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:508:14
    at Receiver.flush (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:347:3)
    at Receiver.finish (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:541:12)
    at Receiver.expectHandler (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:499:31)
    at Receiver.add (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/Receiver.js:103:24)
    at TLSSocket.realHandler (/app/node_modules/gdax-trading-toolkit/node_modules/ws/lib/WebSocket.js:825:20)
    at emitOne (events.js:115:13)
    at TLSSocket.emit (events.js:210:7)

With Bittrex
2017-10-01T05:18:45.395Z - debug: Connection to wss://socket.bittrex.com/signalr  has been established.
  TypeError: Cannot read property 'Nounce' of undefined
at BittrexFeed.processSnapshot (/app/node_modules/gdax-trading-toolkit/src/exchanges/bittrex/BittrexFeed.ts:223:28)
at client.call.done (/app/node_modules/gdax-trading-toolkit/src/exchanges/bittrex/BittrexFeed.ts:64:56)
at callCallbacks.(anonymous function) (/app/node_modules/signalr-client/signalR.js:429:6)
at handleCallResult (/app/node_modules/signalr-client/signalR.js:436:11)
at WebSocketConnection.<anonymous> (/app/node_modules/signalr-client/signalR.js:748:7)
at emitOne (events.js:115:13)
at WebSocketConnection.emit (events.js:210:7)
at WebSocketConnection.processFrame (/app/node_modules/websocket/lib/WebSocketConnection.js:547:26)
at /app/node_modules/websocket/lib/WebSocketConnection.js:321:40
at _combinedTickCallback (internal/process/next_tick.js:131:7)

Are you using ts-node? If not, try this:
npm -g ts-node typescript
ts-node tutorials/t001_feeds.ts

If you are, what version of ts-node? My versions are:

gdax-tt 0.1.16
ts-node 3.3.0
typescript 2.4.1

I was able to get this working using vanilla javascript. Try building the script one part at a time, instead of copy/paste, and make sure the individual parts work before everything is in the script. If you're familiar with javascript it's easy to 'convert' it from ts.


Fixed line break issues in the validation documentation.

Title says it all, I haven't added any additional contribution yet but it was just hurting my eyes when I was reading up on the documentation. Thought I may as well fork the project and create a simple pull request.

check out the docs in the gh-pages branch. these are really just left over from it. should probably remove 'em in the master branch. thanks though!


coreDoMatch does not ignore case differences in key names

Issue: Given the following statement:
obj = {fooKey : "fooValue"}
obj2 = parseJson{"{""fooKey"":""fooValue""}")

Then:
obj.items()[0].key = "fookey"
obj2.items()[0].key = "fooKey"

Note the difference in casing of the string representations of these keys.
So brsHamcrest's coreDoMatch needs to account for this when comparing key names.

Closed by #26


Write a Java program to convert centimeters to feet

Description
Write a Java program to convert centimeters to feet
1 foot = 30.48 centimeters
Input  : 152.4
Output : 5

How to contribute

Save the solution in program/ConvertCentimetersToFeet.java file
Add ConvertCentimetersToFeet.java file in convert-centimeters-to-feet folder

!assign

!assign


[main] Upgrade to latest dependencies

Cron -knative-prow-robot
/cc knative-extensions/serving-writers
/assign knative-extensions/serving-writers
Produced by: knative-extensions/knobots/actions/update-deps

/lgtm
/approve

/lgtm

/lgtm

@dprotaso you might want to override the lint check. I think its the same on other bump PRs as well with the 1.30 deps.

/override "style / Golang / Lint"


Fix broken SharePoint Server connector link

This change is related to [logic-apps]

@divyaswarnkar - Would you review the proposed changes?  Thanks

This PR only makes change to the TOC. Has the file name change already completed (otherwise the link will be broken) ?

@divyaswarnkar the file does exist already and it is even accessible with the current version of Azure Docs.
This PR is fixing the URL of an already broken link.

looks good !


add gauges for frequency, skew and update interval

Adding some missing metrics that are available in chronyc tracking info.
Reference:
https://blog.netdata.cloud/chrony-monitoring/

This would be useful to me, can you merge this?

@SuperQ Thanks for merging this!


Copying images from mac to Dev board

I have been successfully running the demos and now i am trying to copy images from my mac to the dev board using scp and i keep getting
Permission Denied (Public Key)
scp tv.jpg mendel@xx.xx.xx.xx:/home/mendal/images
tried sudo scp as well

OH, this isn't a permission denied on your host machine, so sudo isn't going to works.
Simply, Mendel OS is rejecting the file because it doesn't know who your host machine is. In order to add your host to a list of authorized devices on the board, do this:
Create a id_rsa key on your mac with:
$ ssh-keygen

This creates a ~/.ssh/id_rsa.pub file on your MAC. You can copy that key over to the board and put the content in ~/.ssh/authorized_keys (you can put multiple keys in this file for different host machines):
$ sudo systemctl restart ssh

Now you can start scp-ing:
$ scp filename mendel@ip-addr:/path/

I did something like this when i flashed the board

Can you cat your keys and the authorized file to make sure they are matching? If it's not, then you will run into this issue.
Other wise you can also enable password authentication on mendel.
sudo nano /etc/ssh/sshd_config

change PasswordAuthentication from no to yes and restart ssh service:
sudo systemctl restart ssh

Then you can ssh and scp using password instead, the default password is mendel

thanks it worked now


Backend security

Description:
This is to support backend security for backend services in a http route
Design
https://github.com/wso2/apk/pull/551

https://github.com/wso2/apk/pull/568 merged


Neatly-aligned multi-line expression folded into a single line

I know it's a tough edge case, but rustfmt is not aware of multi-line formatting patterns/regularities in expressions.
I work with image processing and my code is full of expressions repeated for R, G, and B. Laying out such expressions this way:
let diff = (r as i32 - r2 as i32).pow(2) +
           (g as i32 - g2 as i32).pow(2) +
           (b as i32 - b2 as i32).pow(2);

makes it much easier to understand, spot errors, and edit them (with sublime's multiple carets).
However, rustfmt treats it as just a one long expression, and always unwraps it given a chance:
let diff = (r as i32 - r2 as i32).pow(2) + (g as i32 - g2 as i32).pow(2) + (b as i32 - b2 as i32).pow(2);

Would it be possible to preserve such aligned blocks of code? e.g. if parens and operators are aligned, and/or if there's a small edit distance between the lines.

Here's another case of a compact and IMHO very readable matrix notation exploded into multiple unaligned lines:
let custom_primaries = CIExyYTRIPLE{
    Red:   CIExyY{x:0.630, y:0.340, Y:1.0},
    Green: CIExyY{x:0.310, y:0.595, Y:1.0},
    Blue:  CIExyY{x:0.155, y:0.070, Y:1.0},
};

→
let custom_primaries = CIExyYTRIPLE {
    Red: CIExyY {
        x: 0.630,
        y: 0.340,
        Y: 1.0,
    },
    Green: CIExyY {
        x: 0.310,
        y: 0.595,
        Y: 1.0,
    },
    Blue: CIExyY {
        x: 0.155,
        y: 0.070,
        Y: 1.0,
    },
};

Unfortunately rustfmt is not smart enough to do these types of formatting. For now, please try #[rustfmt_skip] or #[cfg_attr(rustfmt, rustfmt_skip)] (more on README.md).

This is one of the the larger pains I have with code formatting tools in most languages, where I otherwise love being able to automatically enforce style consistency.
@topecongiro: Is there an architectural reason that rustfmt can't (or would have a difficult time) supporting this behavior?
Would a pull request implementing it be likely to be accepted? (Any other issues specific to preserving well aligned code?)

@kestred we basically can't do this - the architecture of rustfmt is that it rewrites the AST, not the source, and we don't take hints from the source in general. We found that if we do take hints from the source then we end up with non-idempotency.

Tangentially, I suspect this closed issue may not be the right place for a slightly more involved discussion ^; happy to move somewhere else if it makes sense (rustfmt RFC? internals forum?)


Move SerialConsole to ComputerSystem

Also in 2020.3 Redfish moved SerialConsole to the ComputerSystem resource.
More information can be found at http://www.dmtf.org/sites/default/files/Redfish_Release_2020.3_Overview.pdf (slide 12)

Change profile to have SerialConsole either in Manages or ComputerSystem.


Don't dispose previous pages in dev mode

In dev mode, when navigating from e.g index page to page B, it will then after a while destroy the index page: Disposing inactive page(s): /. Why not keeping it in memory, at least as long as there aren't too many pages built?
Rather than disposing on timeout, it appears better to me to dispose pages when there are too many of them in memory.
This would allow to then have fast client-side transitions (after the first load), which allows to have a feel of these transitions without needing to deploy to prod.

"too many pages" is kind a hard to decide.
What we can do is to provide an option on asking how many pages to buffer in the memory.
I like that and we can default that to 2.

Is there any way for disable disposing pages or set it count to infinite? Yes, it can potentially affect memory usage, but I want to disable it unconditionally.
Any solution, except implicit next.js library code patching, is appropriate. Thanks in advance.

@timneutkens could maybe comment on why this was closed?

@sedubois inactivity. I went through all inactive issues.

This problem also bother me. Is there any solution recently? thanks.

has anything changed related to this issue so far?

@kunokdev it's configurable now in v4 beta https://github.com/zeit/next.js#configuring-the-ondemandentries


nixos/nvidia: Add cuda option

Description of changes
Install cuda by default when people mention serivces.xserver.videoDriver = [ "nvidia" ];.
related: https://github.com/NixOS/nixpkgs/issues/189217
cc @FRidh @NixOS/cuda-maintainers
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

In what situations would this be preferable to the current system of adding the necessary cudaPackages (or equivalently cudatoolkit) to the RUNPATH of individual packages based on their needs? Why introduce a global installation in a privileged location?

In what situations would this be preferable to the current system of adding the necessary cudaPackages (or equivalently cudatoolkit) to the RUNPATH of individual packages based on their needs? Why introduce a global installation in a privileged location?

Situations where cuda availability isn't critical, but a nice-to-have. AFAIK, lots of software may want to make use of cuda, but defaults to a less hardware-accelerated code path if it can't find it.
Deferring to individual package mantainers also isn't as scalable, meeting the assumptions of many downstream consumers seems to be a better user experience.

n *-bin situations where we need to patch existing binaries/libraries we use RUNPATH patching, but

This change would likely make it obsolete if it already adds the OpenGL path. However, there might be non-NixOS use cases which still need RUNPATH to contain cuda.

when building from source cudaPackages are handled as good ole fashioned buildInputs.

Yea, if the package needs cuda at build time, I don't think there's anyway around this. Although I'm curious how the interaction between different cudatoolkits willhave.

Yea, if the package needs cuda at build time, I don't think there's anyway around this. Although I'm curious how the interaction between different cudatoolkits willhave.

Indeed, CUDA versions can be quite finnicky and they do not shy away from making breaking changes. This makes the maintenance of a global CUDA version highly challenging, eg. "I need to run CUDA-optional packages X and Y, but they do not support any CUDA versions in common".
We've encountered this quite a bit already with different ML frameworks having differing CUDA requirements. Since we rely on using cudaPackages as buildInputs there are no conflicts, however.

This change would likely make it obsolete if it already adds the OpenGL path. However, there might be non-NixOS use cases which still need RUNPATH to contain cuda.

I'm not sure I follow... How would this use case be obviated in the situation that *-bin package relies on a CUDA version different from what the user has selected for their global install?

not sure if this is the correct path foreward, seem like cuda might be more in the domain of packaging than the domain of the system.

I don't actually think cudatoolkit includes the full version of libcuda, just the stubbed version.

I don't actually think cudatoolkit includes the full version of libcuda, just the stubbed version.

Yes, the actual libcuda.so comes from kernelPackages.nvidia_x11

I guess I'm not familiar enough with cuda to move forward with this, closing.

I think everything needed is already installed with serivces.xserver.videoDriver = [ "nvidia" ]; The only thing left for the user is to use nixpkgs with config.cudaSupport = true so that the built packages also know to use cuda


Seperate sort order for different albums

Migrating from simple gallery, and one of the only major things I miss is the ability to have different albums sorted in different ways.
I have some curated folders that I want ordered alphabetically, but I'd also like to be able to have albums like camera and screenshots ordered by time.
Thanks for your hard work on this app!

Duplicate:

#207


Is it possible to handle 2 TrackPlayers in the same app?

Sup y'all. I have a very basic music streaming app. The core functionalities of the app are to play an online radio stream and a bunch of playlists. The playlists are working wonders thanks the community discussions and docs. However things get tricky when I add a second Track Player. Let's call them RadioPlayer and PlaylistPlayer.
The project fortunally reads my radio stream url and plays it in my RadioPlayer, awesome. However in the second screen (the PlaylistsPlayer) it's supposed to be a different player. If I open up a music using in the PlaylistsPlayer, suddenly the commands from my RadioPlayer screen now affect the PlaylistsPlayer.
Bottom line, I would like to make them more separate. When one plays, the other shuts down, that's the logic. Is it possible to use 2 TrackPlayers? Or will I have to write some detailed logic using only 1 TrackPlayer?
Thanks in advance, thank you for taking the time to read this!

are you fix bug this?

Did you ever figure this out?


Change the format of the app to a config style operation

Refactor the code to use a config file that is brought into the app environment through env variables as specified in a YAML file

Refactor the code into a config style


Add functionality to cache vertex buffers on the hard drive

Some Scribble operations are quite slow (especially the new .fit_to_box() method). In a lot of cases, the text shown between runs of the game is identical. It makes sense for the developer to be able to cache vertex buffers to disk to avoid having to regenerate text models at runtime.
This system would likely only be of benefit on desktop and mobile devices as consoles have specific requirements when it comes to saving data.

Sacking this off for another time. Not an urgent must-have feature by any stretch of the imagination

if nothing else, the user could just foreach over the scribble cache and save each of the buffers themselves

Can't think of a time when this would actually be useful

I can admittedly think of times when this would be useful, but right now you're adding/removing/changing stuff so fast I'm sure it would constantly break with each update :p

Convince me...


Checking if there is a connection

Hi, so I am looking for a function which checks if there is a connection established to the azure iothub server? Maybe returns a boolean or 0/1.  Currently I am using client = IoTHubDeviceClient.create_from_connection_string(CONNECTION_STRING) and then client.connect(). Thanks!

@San42 Yes, this is a gap in the current SDK.  We will be looking into this right after GA and will keep this item open for tracking.

I would be interested when this feature is ready


Fix resource names used for annotation of variable ops

To facilitate conversion of variable ops (used in the experimental disable_graph_freezing mode) the converter annotates the graph with the shape of the variable ops.
This PR fixes the mapping between captured input names and variables, so that the graph can be annotated correctly.

Hi @tfeher This PR is in draft, any update on this? Please. Thank you!

closing this in favor of #60076


Added styling for graphs and tooltips

This commit adds light/dark specific styling for graph elements such as gridlines and interactive tootlips.


Problem with nativefiering skype for web

Description
When create app for web skype using command nativefier "https://web.skype.com", start it and sign in, site say: Please update your browser to start using Skype
Steps to Reproduce Issue

Create app: nativefier "https://web.skype.com"
Start application
Sign in

Specifications

Version of Nativefier (run $ nativefier --version): v6.12.1
Version of Node.js (run $ node --version): v4.4.0
OS: Ubuntu linux 15.10
Architecture 64

Try to use a later version of the user agent.
$ nativefier "https://web.skype.com" --user-agent "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36"

This works for me. However, it requires me to install a chrome extension to make voice or video calls, which is not supported on nativefier :(

@jiahaog Thanks.
It's working.
As a linux user it's better to use this solution instead of Skype v4.
And I don't need to use calls and this solution is better :)


fix(STONEINTG-627): clarify SLO2 as SLO for static envs

SLO 2, now SLO 2A, is about static environments only. Make this clarification in code base and grafana.
This commit also adress STONEINTG-675
Maintainers will complete the following section

[ ] Commit messages are descriptive enough (hints)
[ ] Code coverage from testing does not decrease and new code is covered (check the PR coverage on codecov)
[ ] Controllers diagrams are updated when PR changes controllers code  (if applicable)

/retest

/test integration-service-e2e

/retest


[Doc]Fix typo and language issues in the adapter-kafka.md file

Motivation
Fix typo and language issues in the adapter-kafka.md file. I'm trying to make it clear, concise and logical.
Modifications
Refine typos;
Refine from the language perspective, make it easy to read and understand;
Refine some answers, make it clear and correct;

run java8 tests


WebUiUrl is not accessible after deployed the solution stack

Feature name
Give your feature a name.
-WebUiUrl is not accessible after deployed the solution stack
Is your feature request related to a problem? Please describe.
A description of what the problem is.
WebUiUrl is not accessible after deployed the solution stack
https://d3mjzdvwbwcshm.cloudfront.net/
I need assistance to complete my post deployment steps to use the solution in our environment.
Error:

AccessDenied
User: arn:aws:sts::856369053181:assumed-role/OriginAccessControlRole/EdgeCredentialsProxy+EdgeHostAuthenticationClient-DEL54-P7 is not authorized to perform: kms:Decrypt on the resource associated with this ciphertext because the resource does not exist in this Region, no resource-based policies allow access, or a resource-based policy explicitly denies access
AAFAS781YFYA8TXA
vv0H8OFH6HHEVaqFPV/rL3q+OEIkYZpA5uHSsUTKYqKTnEsAbWsOVl9C1GUnwsSnLyJzjMA3hQ4=

Describe the feature you'd like to see implemented
A description of what you would like to see.
Describe the value this feature will add to AWS Perspective
Tell us how this feature might improve AWS Perspective.
Describe alternatives you've considered
A description of any alternative solutions or features you've considered.
Additional context
Add any context or screenshots about the feature request here.

I have deployed the Solution stack in us-east-2 (Ohio) and cloudFront also deployed in same region. Is there any region restriction for CloudFront ?
Can you please share your e-mail ID so that I can show you the error that I am facing for WebuiURL?

I have never seen an error like this before but it looks like it could be an SCP associated with the account that Workload Discovery was deployed to. The arn:aws:sts::856369053181:assumed-role/OriginAccessControlRole/EdgeCredentialsProxy+EdgeHostAuthenticationClient-DEL54-P7 is not deployed by the solution. As you can see here there is no role assoicate with the AWS::CloudFront::OriginAccessControl resource provisioned by CloudFormation: https://github.com/aws-solutions/workload-discovery-on-aws/blob/3a7e39605e0937f3c14a34c8230f8ac80fbeadfd/source/cfn/templates/webui.template#L43.

Hi Stefano,
Thanks for update.
Quick questions:

Is there any region restriction for CloudFront if I have deployed the Workload Discovery Solution stack in us-east-2 (Ohio)?
Can this solution be deployed in CloudFront US-East-2?

Please confirm me.
Regards,
Dalkeshwar Prasad

I'm not sure what you mean by deploying CloudFront in us-east-2? CloudFront is a global service so it doesn't have a region associated with it. The solution can be deployed in us-east-2; I have done so many times before. A list of the supported regions can be seen in the documentation: https://docs.aws.amazon.com/solutions/latest/workload-discovery-on-aws/supported-aws-regions.html.

Closing due to inactivity.


Font Request: Artix Linux

png logo: https://artixlinux.org/img/artix-logo.png

We also provide the original SVG images:


Class names are not passed to webviews

https://github.com/mozilla/tofino/issues/147

@jsantell take a quick look at this please. Class names are now properly passed into the webview element in the shadow dom. I'll fix the "I have no idea why we need this" comment in https://github.com/mozilla/tofino/issues/113, it's related to this problem.

Wow, good eye. I guess we don't have any ways of testing WebViews yet?
r+


FileOpenPicker, FileSavePicker, and FolderPicker break in WinUI3 Desktop

Describe the bug
The FileOpenPicker, FileSavePicker, and FolderPicker in the WinUI3 Desktop sample solution break and close the application.
Steps to reproduce the bug

Clone the WinUI3 Problems FilePicker repository.

Go to the FilePickerWinUI folder.

Open the FilePickerWinUI solution in Visual Studio 2019 Preview.

Build and run with Debug x64.

Test each button
A. FileOpenPicker
 1. Click the FileOpenPicker button.
 2. Select one or more files.
 3. Click [Open].
 4. The application will immediately close.

B. FileSavePicker
 1. Click the FileSavePicker button.
 2. The application should crash with an error. See Screenshot#1

C. FolderPicker
 1. Click the FolderPicker button.
 2. Select one folder.
 3. Click [Select Folder].
 4. The application will immediately close.

Expected behavior
We expect the application to display the path of the selected file(s) or folder.
We expect the FileOpenPicker, FileSavePicker, and FolderPicker to allow the user to select files or a folder.
Screenshots

Screenshot#1 - Current Behavior (Error Message)

Screenshot#2 - Application Appearance
Version Info
NuGet package version:
[Microsoft.VCRTForwarders.140 1.0.6]
[Microsoft.WinUI 3.0.0-preview1.200515.3]
Targeting:
Target: Universal Windows
Target version: Windows 10, version 1809 (10.0; Build 17763)
Min version: Windows 10, version 1809 (10.0; Build 17763)

Windows 10 version
Saw the problem?

Insider Build (xxxxx)

November 2019 Update (18363)

May 2019 Update (18362)

October 2018 Update (17763)
Yes

April 2018 Update (17134)

Fall Creators Update (16299)

Creators Update (15063)

Device form factor
Saw the problem?

Desktop
Yes

Mobile

Xbox

Surface Hub

IoT

Additional context
We copied the related C# code from the microsoft/WinUI-3-Demos.
You will see this in App.xaml.cs and MainWindow.xaml.cs.
If we set the Debug -> Debugger Type -> Application proccess to Native Only, then the FolderPicker will work without crashing. However, the other two buttons will still not work.

@stevenbrix and @Scottj1s, @llongley thinks this is a CSWinrt issue. FYI

I can't tell from the documentation, it could be that these pickers don't work in a Desktop (hwnd rather than CoreWindow) app.

It works if no debugger is attached, or if the Native Only debugger is attached. This seems like a tooling issue, or a Dot Net Core runtime issue. I believe these pickers worked fine on Xaml Islands.

I can't get any pickers to work at all in a Desktop (HWND) Win32 app.
necore\shell\lib\calleridentity\callerwindow_twinapi.cpp(116)\twinui.appcore.dll!00007FF8D3EC0BDC: (caller: 00007FF8D3E91E10) ReturnHr(1) tid(cd18) 80040155 Interface not registered
CallContext:[\PickSingleFileAsync\SingleStorageItemOperation]
Exception thrown at 0x00007FF905DD226C (KernelBase.dll) in App2.exe: WinRT originate error - 0x80070578 : 'Invalid window handle.'.
Exception thrown at 0x00007FF905DD226C in App2.exe: Microsoft C++ exception: winrt::hresult_error at memory location 0x000000305EF8CEE8.
winrt::fire_and_forget MainWindow::ShowPicker()
{
FileOpenPicker open;
open.SuggestedStartLocation(PickerLocationId::DocumentsLibrary);
open.FileTypeFilter().Append(L".txt");
auto file = co_await open.PickSingleFileAsync();
if (file)
{
}
}

Since WinUI3 allows multiple windows on the same thread, the pickers can no longer assume there's just one and use it as the owner. You will need to use the IInitializeWithWindow interface to give the hint. Looks like the documentation has been updated to give some clues about this now:
FileOpenPicker and IInitializeWithWindow.

This issue is closed but I still face the same exact issue and I can not find a solution in this thread.
The InitializeWithWindow was already used in the question (see screenshots).
The given workaround to "set the Debug -> Debugger Type -> Application proccess to Native Only"  works but the  hability to debug Managed code is considered essential in our development workflow so is not a long term solution.
I use
Visual studio 16.7.5
.Net SDK 5.0.100-preview.5.20279.10
WinUI 3.0.0-preview2.200713.0

@angelazhangmsft are you able to confirm if this issue has been fixed? I thought there was an associated C#/WinRT issue for this, but am not seeing it in this thread.

@Scottj1s @j0shuams do you know if this issue has been fixed?

From what I could tell these are not C#/WinRT issues. When I encountered this it was with XCG and had to do with their implementation -- I made an issue there https://github.com/microsoft/Xaml-Controls-Gallery/issues/559
Doesn't look like it has been fixed. @stevenbrix is this the issue you are talking about? I think it is a different issue than the one discussed here.

@j0shuams the symptom of this issue is that debugging a .NET app with just the native debugger works, but when you attach the managed debugger, you get an issue. I can't tell from that linked issue whether that is the same issue as this one, but my gut is that it isn't (I could be wrong of course)

@stevenbrix No I don't think the two are related (the issue I linked and this one). My understanding of the issue of this thread was it had to do with providing a window handle hint to Picker objects (FileSavePicker, etc). I don't think there is a C#/WinRT issue about debugging with managed being broken -- is that a C#/WinRT issue? I don't think I know enough to make that call; if you think so then youcould open an issue on that repo. Let me know how else I can help

Apologies for closing this and missing that IInitializeWithWindow was already being used. I'll reopen this until folks figure out whether this is a WinUI3 or CSWinRT issue and route the bug report accordingly.

@j0shuams the symptom of this issue is that debugging a .NET app with just the native debugger works, but when you attach the managed debugger, you get an issue. I can't tell from that linked issue whether that is the same issue as this one, but my gut is that it isn't (I could be wrong of course)

This is actually a different issue than I was talking about. They say that switching the debugger solves the problem for FilePicker but not FileOpenPicker and FileSavePicker. @RealTommyKlein and I have discussed this and think it is some kind of issue with Desktop apps and file pickers. We came to this after I found this in a test run of XCG.

Sorry for leaving this dormant for so long.  We have confirmed this is fixed in WinUI 3 Preview 3 which will be coming out soon - when that comes out we will also be publishing a new version of the XAML Controls Gallery app to its GitHub, which will show how to do this so you can see the app code needed.
In short, it looks like this (but again, this may not work fully until WinUI 3 Preview 3).  Note how this uses C#/WinRT's "As" method instead of Marshal, which is not supported as part of C#/WinRT's way of doing projections:
[ComImport, System.Runtime.InteropServices.Guid("3E68D4BD-7135-4D10-8018-9FB6D9F33FA1"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
public interface IInitializeWithWindow
{
    void Initialize([In] IntPtr hwnd);
}

[DllImport("user32.dll", ExactSpelling = true, CharSet = CharSet.Auto, PreserveSig = true, SetLastError = false)]
public static extern IntPtr GetActiveWindow();

// Open a text file.
FileOpenPicker open = new FileOpenPicker();
open.SuggestedStartLocation = PickerLocationId.DocumentsLibrary;
open.FileTypeFilter.Add(".rtf");

// When running on win32, FileOpenPicker needs to know the top-level hwnd via IInitializeWithWindow::Initialize.
if (Window.Current == null)
{
    IInitializeWithWindow initializeWithWindowWrapper = open.As<IInitializeWithWindow>();
    IntPtr hwnd = GetActiveWindow();
    initializeWithWindowWrapper.Initialize(hwnd);
}

StorageFile file = await open.PickSingleFileAsync();

Sorry for leaving this dormant for so long. We have confirmed this is fixed in WinUI 3 Preview 3 which will be coming out soon - when that comes out we will also be publishing a new version of the XAML Controls Gallery app to its GitHub, which will show how to do this so you can see the app code needed.
In short, it looks like this (but again, this may not work fully until WinUI 3 Preview 3). Note how this uses C#/WinRT's "As" method instead of Marshal, which is not supported as part of C#/WinRT's way of doing projections:
[ComImport, System.Runtime.InteropServices.Guid("3E68D4BD-7135-4D10-8018-9FB6D9F33FA1"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
public interface IInitializeWithWindow
{
    void Initialize([In] IntPtr hwnd);
}

[DllImport("user32.dll", ExactSpelling = true, CharSet = CharSet.Auto, PreserveSig = true, SetLastError = false)]
public static extern IntPtr GetActiveWindow();

// Open a text file.
FileOpenPicker open = new FileOpenPicker();
open.SuggestedStartLocation = PickerLocationId.DocumentsLibrary;
open.FileTypeFilter.Add(".rtf");

// When running on win32, FileOpenPicker needs to know the top-level hwnd via IInitializeWithWindow::Initialize.
if (Window.Current == null)
{
    IInitializeWithWindow initializeWithWindowWrapper = open.As<IInitializeWithWindow>();
    IntPtr hwnd = GetActiveWindow();
    initializeWithWindowWrapper.Initialize(hwnd);
}

StorageFile file = await open.PickSingleFileAsync();

When I try the above with Microsoft.WinUI 3.0.0-preview3.201113.0 I get the below error:
Member 'FileOpenPicker.As<GeneralPage.IInitializeWithWindow>()' cannot be accessed with an instance reference; qualify it with a type name instead

Am I using the right nuget that includes this fix?

WinUI3 Preview 3 is already available since yesterday.
I tested the XAML Controls Gallery app and the RichEditBoxPage that uses a FileOpenPicker now work correctly with c# debugger on.
So the issue is fixed.
I don't have the error @akanieski mention.
I installed Visual Studio 16.9 Preview 1 (with a fix for installation (bug)[https://github.com/microsoft/microsoft-ui-xaml/issues/3635]
git pulled the winui3preview branch of Xaml-Controls-Gallery
I tested XamlControlsGallery.Desktop.sln

@akanieski the As method used in Xaml-Controls-Gallery refers to WinRT.CastExtensions.As(this object value).
Maybe you need to add
using WinRT;

Unfortunately I still get this, with all the latest bits:

Thanks everybody for participating on this issue.  I have updated the WinUI 3 Demos to the Preview 3 and it seems that every scenario works now.
I'll close the issue.
Regards!

Sorry for leaving this dormant for so long. We have confirmed this is fixed in WinUI 3 Preview 3 which will be coming out soon - when that comes out we will also be publishing a new version of the XAML Controls Gallery app to its GitHub, which will show how to do this so you can see the app code needed.
In short, it looks like this (but again, this may not work fully until WinUI 3 Preview 3). Note how this uses C#/WinRT's "As" method instead of Marshal, which is not supported as part of C#/WinRT's way of doing projections:
[ComImport, System.Runtime.InteropServices.Guid("3E68D4BD-7135-4D10-8018-9FB6D9F33FA1"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
public interface IInitializeWithWindow
{
    void Initialize([In] IntPtr hwnd);
}

[DllImport("user32.dll", ExactSpelling = true, CharSet = CharSet.Auto, PreserveSig = true, SetLastError = false)]
public static extern IntPtr GetActiveWindow();

// Open a text file.
FileOpenPicker open = new FileOpenPicker();
open.SuggestedStartLocation = PickerLocationId.DocumentsLibrary;
open.FileTypeFilter.Add(".rtf");

// When running on win32, FileOpenPicker needs to know the top-level hwnd via IInitializeWithWindow::Initialize.
if (Window.Current == null)
{
    IInitializeWithWindow initializeWithWindowWrapper = open.As<IInitializeWithWindow>();
    IntPtr hwnd = GetActiveWindow();
    initializeWithWindowWrapper.Initialize(hwnd);
}

StorageFile file = await open.PickSingleFileAsync();

When I try the above with Microsoft.WinUI 3.0.0-preview3.201113.0 I get the below error:
Member 'FileOpenPicker.As<GeneralPage.IInitializeWithWindow>()' cannot be accessed with an instance reference; qualify it with a type name instead

Am I using the right nuget that includes this fix?

I have this issue too. I don't know how XAML controls gallery works but mine no. I included also the same nuget packages

The workaround described by @akanieski does only work when using PickSingleFileAsync().
An exception is still thrown when using PickMultipleFilesAsync().
See: https://gist.github.com/wbokkers/cc8bcc7bc5a646b82a4d41b337330c69#gistcomment-3649439

@wbokkers - I think that issue may be better tracked on the Project Reunion repo here: https://github.com/microsoft/ProjectReunion
Could you file that new issue there?  Thanks!

@Austin-Lamb @wbokkers I have created a new issue in the Project Reunion repository. See mentioned issue above!

I'm getting an error trying to use IInitializeWithWindow with a c++ app. #5218

This still happens in .NET 6.0.100-rc.1.21458.32 using VS 2022 Preview in a MAUI Blazor project.

On .NET 6.0 RTM too

@marb2000 any info about that?

Why is this closed while the API is still broken? @marb2000

The team is looking to improve the pattern for these APIs that require interop with IInitializeWithWindow. I've started a discussion at https://github.com/microsoft/WindowsAppSDK/discussions/1887!


[ERROR] Unexpected moveset [Tackle, Swift] for #120 Staryu, please update info in pokemon.json and create issue/PR

[ERROR] Unexpected moveset [Tackle, Swift] for #120 Staryu, please update info in pokemon.json and create issue/PR

Are you using the Dev branch?

No, sorry, I was using the master brach, but I just realized it is already fixed in the Dev.


Add "zero config" HTTPS support using local development certificate.

This change enables automatic HTTPS using a development certificate found in the user store. Any URLs containing the https scheme will be configured with that certificate.
Paging @Eilon since this is a breaking change (previously we would throw upon seeing an https URL).
So now if you set ASPNETCORE_URLS (or use UseUrls()) to e.g. https://localhost:5001, you'll get HTTPS if you add Kestrel with no listen options i.e.
var host = new WebHostBuilder()
    ...
    .UseKestrel()
    ...

This turned out to be more convoluted than I anticipated. I'm hoping someone can suggest a simpler way to achieve the same result.

Paging @Eilon since this is a breaking change (previously we would throw upon seeing an https URL).

I don't see this as a breaking change. At most a behavior change, and you are weakening the precondition (allowing something that wasn't allowed before) so I don't think this is a breaking change.

To me this looks like a minor breaking change, but an acceptable one.  If you specify https for your URL, your app would fail to start before this. Now it'll do what you (presumably) wanted anyway.

@halter73 To get the test cert set up on your machine, clone this PR https://github.com/aspnet/Common/pull/263/files#diff-1f595d265c92ca9d7a059ed3d0d223fbR33 and run the tests. @javiercn can give you more info.

Injecting IDefaultHttpsProvider in the KestrelServer ctor is a breaking change - I had to add an exception for ApiCheck. However, given these are injected parameters, is that an acceptable breaking change for a minor version? @muratg @Eilon

@cesarbs Couldn't you just add a second constructor that calls the original one with a null IDefaultHttpsProvider? Of course, you'd want to keep the old behavior if IDefaultHttpsProvider is null.

Yeah just do what @halter73 suggested and there's no breaking change at all in terms of source compat, binary compat, runtime behavior, etc. It's nearly always fine to throw fewer exceptions and be more permissive.

New/updated sample?

Updated to use https://github.com/aspnet/Common/blob/b9bc076c782af4a9664b34b561fd91d37e6edda4/shared/Microsoft.AspNetCore.Certificates.Generation.Sources/CertificateManager.cs to find development certificate.

Rebased.

Any further comments beyond my own re:testing? I'm going to spend a few quick cycles seeing if I can tidy up the test, but otherwise it looks OK to me.

I'm no expert but it looks good to me.

I'm wondering how well this will generalize when we implement the config file scenarios. E.g. If you specify a default cert in config that should take precedence over the dev one from the cert store but still work with https entries in URLs.
Devs also want the top-level UseHttps back where they can configure it in code, which could plug into this HttpsProvider somehow. It's not clear if the new dev cert and config file approaches will cover this need.

:up: :date: I gave up with the testing refinement. But I did notice that if for some reason DefaultHttpsProvider isn't provided (because it is an optional dependency specified in a separate ctor, even if .UseKestrel adds it by default), the user gets a rando null-ref exception. So, I added a few tests and some logic to ensure that when there isn't an IDefaultHttpsProvider you get a nice error in the right place.

Devs also want the top-level UseHttps back where they can configure it in code, which could plug into this HttpsProvider somehow

Agree, but I think that's something we can iterate on when we have the cert config story worked out. Is there an issue tracking that?

https://github.com/aspnet/KestrelHttpServer/issues/1290

:up: :date: Using CertificateManager shared-source package now. Also, added some more logging and exception messages.

:up: :date: Responded to feedback, including @javiercn 's comments re messaging.

:up: :date: resolved last few pieces of feedback