Compiling hangs when building modules

Bug Report
I've installed and configured Docz within my project, and when I have no .mdx files in the directory, and run docz dev, the server starts up completely fine. I navigate to http://localhost:3000 and see the Docz app with a 404 error (which is expected since I have no files created). This tells me that docz is configured fine (I'm using webpack 4 and babel 6 in combination with the babel6 plugin).
Now, when I actually add a simple intro.mdx file and run docz dev, it hangs on building modules.
This is the contents of the file:
---
name: Intro
---

# Hello World

><EMAIL_ADDRESS>docs C:\xampp\htdocs\kwuikit
> docz dev

i  info      Removing old app files
i  info      Creating new docz files
i  info      Setup entries socket on port 8089

Compiling

* Client [Loading bar ] building modules (55%) 377/378 modules 1 active
  docs\intro.mdx <!--- HANGS RIGHT HERE

Expected behavior
I would expect with such a simple file that it properly loads the page, and I would see an Intro page when I navigate to http://localhost:3000
Enviroment

OS: Windows 10
Node/npm version: [Node v8.9.3/NPM v5.5.1]
Docz version: v0.4.0

@tsnolan23 add after name: Intro, route: /
name: Intro
route: /

Now refresh the browser, i guess that will work!

I tried that as well with the route specified, that doesn't actually solve the compiling issue.  It still hangs when compiling even with this:
---
name: Intro
route: /
---

# Hello World

@tsnolan23 Can you give me a repository with example? I need to try reproduce your problem.

It's in a private repo, I'll try to reproduce in another repo and post here.

@nicholasess Thanks for looking at this. I updated all my babel dependencies to the latest version of 6 and removed some unused dependencies, and it seems to not hang anymore. Closing this for now. Will update you if I find the root cause at some point.


Descending GET Filtered is UnSorted

The GET Filtered endpoints have a .ThenBy() to fallback, but if we choose to sort in descending order we are currently inverting the whole array, instead of sorting by descending then by ascending in the fallback

Example:
A1 A2 B1 B2
Should be
A2 A1 B2 B1
But it's being
B2 B1 A2 A1

We are not gonna have multiple filters per query anymore. We barely will have many filter options
We can stick to "having only one filter option" and deciding the rest of the order in the endpoint's code
This issue is stale. Dismissing


Fix watch not processing original files

I'm not 100% sure of the repercussions of this. Please review comprehensively.
Fix https://github.com/jlmakes/karma-rollup-preprocessor/issues/55

Thank you, I'll check it out!


⚠ Bofrost.be has degraded performance

In fdacd31, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 3030 ms

Resolved: Bofrost.be performance has improved in 849bd51.


Where to download the tar file

There's no tar file in the project directory, and no download address.Why

just run the script file, it includes download tar step


Fix access to trash dir

Closes #1355

Codecov Report

Merging #1356 (43ccf76) into main (15ec194) will decrease coverage by 0.00%.
The diff coverage is 77.77%.

@@            Coverage Diff             @@
##             main    #1356      +/-   ##
==========================================
- Coverage   59.52%   59.51%   -0.01%
==========================================
  Files         128      128
  Lines       21643    21663      +20
==========================================
+ Hits        12883    12893      +10
- Misses       7232     7237       +5
- Partials     1528     1533       +5

Impacted Files
Coverage Δ

pkg/vfs/vfs_unix.go
97.79% <71.42%> (-1.08%)
:arrow_down:

pkg/meta/redis_lock.go
74.80% <76.47%> (-0.20%)
:arrow_down:

pkg/vfs/vfs.go
77.61% <100.00%> (+0.03%)
:arrow_up:

pkg/vfs/reader.go
76.45% <0.00%> (-3.11%)
:arrow_down:

pkg/vfs/handle.go
85.71% <0.00%> (-0.85%)
:arrow_down:

pkg/meta/sql.go
67.31% <0.00%> (-0.67%)
:arrow_down:

pkg/chunk/disk_cache.go
80.78% <0.00%> (+0.98%)
:arrow_up:

pkg/vfs/writer.go
79.66% <0.00%> (+1.01%)
:arrow_up:

pkg/meta/sql_lock.go
75.49% <0.00%> (+2.64%)
:arrow_up:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8f20993...43ccf76. Read the comment docs.


fix(test): temporarily remove the EE tests running on prod-preview so…

… that we can debug the PR tests

I think it would make more sense to just disable those jobs rather than deleting them - this PR will do that https://github.com/almighty/almighty-jobs/pull/416

merged #416 as suggested by @vpavlin

Thanks Vaclav!
On Tue, Dec 5, 2017 at 5:27 AM, Vaclav Pavlin<EMAIL_ADDRESS>wrote:

I think it would make more sense to just disable those jobs rather than
deleting them - this PR will do that #416
https://github.com/almighty/almighty-jobs/pull/416
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/almighty/almighty-jobs/pull/410#issuecomment-349261992,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAnOPbe8djZMnrKzjxJL7vS-8FIUKUbyks5s9RqegaJpZM4QvQRw
.

--
Len DiMaggio<EMAIL_ADDRESS>JBoss by Red Hat
314 Littleton Road
Westford, MA 01886  USA
tel:<PHONE_NUMBER>
cell:<PHONE_NUMBER>
http://www.redhat.com
http://community.jboss.org/people/ldimaggio


Tracker task injection on launch

The goal of this PR is to allow users to manage their version of the tracker task across all channels. This way the tracker task code is not committed to their channel repo and so that when the tracker task and desktop RALE app is updated they only need to update it in the one location.

@chrisdp whatever key we finally land on for the comment (vscode_rale_tracker_entry for example), we should add it to the language grammar so it appears a slightly different color in the editor. That is in the syntaxes/brightscript.tmLanguage.json file.


Release 0.9.0 to master

http://influxdb.com/blog/2015/06/11/InfluxDB-v0_9_0-released-with-developer-and-production-support.html

+1

+1 as well

+1

+1

done


Added Fn's to work with any kind of WebGl2RenderingContext source.

Thank you for this! I've left a couple of comments. Also the tests and docs don't seem to build at the moment.


Session resume appears to be broken for me

session-resume on an issue comment for example doesn't seem to be working for me properly in chrome and I just lost a bunch of text from accidentally closing a tab :(
These things work

Type in an issue comment, refresh the tab, text is still there
Type in an issue comment, close the tab, reopen with cmd-shift-t, text is still there

I suspect the browser is doing this though, rather than session-resume.
This does not work

Type in an issue comment, close the tab, open a new tab, navigate to issue url - issue comment box is empty.
Have two tabs to github.com, in one type in an issue comment box, close the tab. In the other sessionStorage is still empty.

I believe these issues stem from the fact that session-resume uses sessionStorage instead of localStorage on github.com. sessionStorage behaves exactly as you described, retaining stored values within a given tab only (even if it's closed and reopened), but not sharing them with other/new tabs. We could consider using localStorage instead, but I think sessionStorage was chosen specifically because we didn't want draft inputs to leak if you closed a tab on a shared computer.


Fix installation docs

Heron installation has changed quite a bit recently. There is now just one installation script and one Homebrew recipe for macOS. This PR brings the docs in line with the current state of affairs.

I just tried following these docs.  Heron doesn't seem to be available on homebrew by default - do you have to tap https://github.com/streamlio/homebrew-formulae first, as hinted to in https://github.com/twitter/heron/issues/2128#issuecomment-322059440? Or should it be available in the main homebrew repository at some point?


Update font-mononoki-nerd-font-mono to 1.1.0

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.
[x] The commit message includes the cask’s name and version.

Additionally, if updating a cask:

[ ] sha256 changed but version stayed the same (what is this?).
I’m providing public confirmation below.

Thank you for the contribution. It was merged directly as d096717f1f07f14dde79eec2deb0e8eb485aae35. Your contribution is still credited to you.


CORS preflight for Authorization Header failed with IIS

Current situation
I'm running an ASP.NET Core 1.1 application as an API Backend and React application as an client frontend. For authentication and authorization i use OpenIdDict and jwt. The Bearer token is send in the Authorization Header.
Locally it works, but when i try to use the backend behind IIS the preflight request is made but the GET request failed with 500 response.
I The following tests running:

Run pure XMLHttpRequest without Authorization / api locally (200 response code)
Run pure XMLHttpRequest with Authorization / api locally (200 response code)
Run pure XMLHttpRequest without Authorization / api behind iis (200 response code)
Run pure XMLHttpRequest with Authorization / api behind iis (500 response code)
Run react without Authorization / api locally (200 response code)
Run react with Authorization / api locally (200 response code)
Run react without Authorization / api behind iis (200 response code)
Run react with Authorization / api behind iis (500 response code)

UPDATE
Here is an Example between client (locally) / api (remote) without Authorization Header which means no preflight request

Here is an Example between client (locally) / api (remote) with Authorization Header which means a preflight request

So for my understanding there is something in IIS which is wrong.
Can someone help me please. I try to fix this more than a week.... :(

What's in the application logs for your 500 responses?

@Tratcher Nothing. It seems that behind IIS the Kestrel is never reaced with Authorization Header

@subprime Could you share FREB logs in IIS for the 500?

@shirhatti Sure but. what do you mean with FREB Logs? I get no errors for the 500 response from IIS. Thats my big problem. I dont know what happens inside..

Can you help me to provide the logs?

https://docs.microsoft.com/en-us/iis/troubleshoot/using-failed-request-tracing/troubleshooting-failed-requests-using-tracing-in-iis

@shirhatti Thanks for the link! After a while of trying to install the TRACE-Addon it works now 👍
I tried to study the logs (IIS_Trace_500_Logs.zip) but i doesnt know why...

@Tratcher / @shirhatti Any idea why this error is thrown?

Looking at your FREB logs.
Pre-flights request succeeds and responds with a 204.
The actual GET request is forwarded to your backend that responds with a 500 after ~2 seconds.
There isn't enough information in the FREB logs to ascertain why it's failing. App logs are your best bet

We're closing this issue as no response or updates have been provided in a timely manner and we have been unable to reproduce it. If you have more details and are encountering this issue please add a new reply and re-open the issue.


Setting to exclude file patterns from editor.formatOnSave

Something like editor.formatExclusions so I can ignore certain files, directories and glob patterns from editor.formatOnSave

You can already do that via language specific settings, e.g
"[html]": {
"editor.formatOnSave": false
},

Is that what you are looking for?

What level on granularity are you looking for? Is this just for format on save or also other settings, like the default formatter or indentation settings etc?

Just format on save. workbench.action.files.saveWithoutFormatting is easy to forget, all it takes is one save and you lost all your manual formatting. My language auto code formatter doesn't have a way to guard sections of a file from auto formatting so it'd be nice to be able to not run the formatter at all on certain files in my project.
If I could have something like:
"[nix]": {
  "editor.formatExclusions": [
    "**/list.nix`
  ],
},

for example that would never format files named list.nix on save.


[P0] Can't reproduce commonsense reasoning numbers

Hello!
I am trying to reproduce commonsense reasoning numbers on LLaMA with this run script: https://github.com/stanfordnlp/pyreft/tree/main/examples/loreft#commonsense-reasoning-tasks
But my eval_results.json after training is showing all zeros:
    "eval/boolq": 0.0,
    "eval/piqa": 0.0,
    "eval/social_i_qa": 0.0,
    "eval/hellaswag": 0.0,
    "eval/winogrande": 0.0,
    "eval/ARC-Easy": 0.0,
    "eval/ARC-Challenge": 0.0,
    "eval/openbookqa": 0.0,
    "n_params": 2097408
}```

I am only reducing batch size from 16 to 8, but other than that everything is identical to the run script. I checked my training log and at some point the loss is nan.

Any advice is appreciated!

BTW, we shared commonsense reasoning logs through wandb (link). You might find it helpful. But since there are changes in this repo as well as in the huggingface transformer repo, this could be a new issue. If you could, also try to lower your transformers version to something like 4.44.0 which is closer to the version we used before.

I am trying ep=6 lr = 1e-4
and ep=3 lr=5e-4 now! will let you know how these 2 turn out

And did you install pyreft by using pip install git+https://github.com/stanfordnlp/pyreft.git?

i used pip install pyreft

@dyahadila Sorry for this late followup.
Any updates on this with additional runs? I am going to close the issue for now, and definitely feel free to reopen (given we provided raw logs for our runs, it is likely stability issue?).


Python 3 Port

I'm not sure if this project is still active or if the devs want to port over to python 3, however, for a personal project, I used this this repo. I use python3 so I ported it over while I was at it.
I think I converted most things over however there's always a possibility that I missed something.
Hope it helps.

Thanks for this port. It works as expected in Python 3


added pybind11 back into requirements.txt post accidental removal

Summary
#236 Re-adding pybind11 to requirements.txt file.
Details and comments
pybind11 added back to requirements.txt file

Adding a do NOT merge label because it seems like qiskit-qec is working correctly without pybind11 installed. I'm pretty confused because setup.py directly imports it from pybind11.setup_helpers import Pybind11Extension, build_ext

@grace-harper-ibm no, I think we should have pybind in requirements

@grace-harper-ibm no replacement I know of, I think we should have pybind in requirements.
One suggestion would be to fix pybind (do == or ~=) because newer version might have some troubles

I made sure to cap it at 2.9.1 so should be good I think


include reviewer_name, source, notes in known/observed habitat view

Useful to know the source when reviewing the data.

potential fix won't really work as is, there could be many sources for a single section of stream. Aggregate?

maybe just the source(s), something like this:
array_to_string(array_agg(distinct h.source order by source), '; ') as sources

lumping all observed habitat issues into #576


FEATURE: Incorporate relocating container images for TAP installation to private registry repository

Right now we source all images and bundles from Tanzu Network. Not optimal for production or air-gap footprints.
See this guide for inspiration.

As of TAP 1.5.0 operators MUST relocate TAP install images using imgpkg to a container registry repository.
Github Action dispatch and call workflows have been implemented that take appropriate inputs and delegate to a BaSH script.
The gitops/tanzu/application-platform tree of manifests have been updated too - instead of referring to the Tanzu Network credentials they now refer to Container Registry credentials secret.
This is now available on the 1.5.0 branch.


pull request for e2e test at 12/04/2016 23:15:03

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add polygon tangens

this pull request closes https://github.com/diogomatoschaves/pyturf/issues/14
Please make sure that:

[x] You have read CONTRIBUTING.md
[x] You Include a link to the issue this pull request is associated to.
[x] The linter has been run at the root level of the project: black .
[x] All tests are passing: python -m pytest --verbose --cov=./
[x] Your branch is up to date with master: git rebase upstream/master

For new modules, also make sure that:

[x] The new module function is exported in turf/<your-module>/__init__.py and turf/__init__.py.
[x] The new module has been added under the Available Modules section on the README.

i closed this pull request, because of the naming issue. The new pull request is found here


Added $BUILDPATH and $BASEPATH support to scriptrunner.cs

Pretty simple does what it says in the title.

@technodragon253 , I am closing this without merging as these changes are now implemented as part of https://github.com/superunitybuild/buildactions/commit/77a14ba451484e93cb941e344067169e1f48ff24, which brings support for $BASEPATH and $BUILDPATH to all Per-Build actions, but it was your PR that inspired this new functionality, so thank you!

Awesome! I'm glad to hear it!


M29440: Possible typo "overridet"

Hello, @sptramer,
Translator has reported possible source content issue.
"Possible typo on word overridet"
Please review and merge the suggested proposed file change to avoid this error. If you make related fix in another PR, then share your PR number, so we can confirm and close this PR.
Many thanks in advance.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-conceptual/azurermps-6.6.0/release-notes-azureps.md
:white_check_mark:Succeeded
View (azurermps-6.6.0)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Upgrading Web3 to v6.0.0

Can we change theWeb3dependency and integrate to allow for stable v6.0.0? The ApeWorX framework uses Web3 v6.0.0 and I ran into a package conflict while pulling the new changes.

We need this to use Cairo-lang 0.11.0 with the Ape Framework


Command needs very important switch!!

Hello,
The below command needs a very important switch, as it caused a mess in my environment by writeback all groups not updated or missed as the below command only is not returning the whole object groups .. it returns only the first 100 group
Simply it needs --> "-All"
Get-mggroup -filter "groupTypes/any(c:c eq 'Unified')" | Update-MsIdGroupWritebackConfiguration -WriteBackEnabled $false
it should be:
Get-mggroup -All -filter "groupTypes/any(c:c eq 'Unified')" | Update-MsIdGroupWritebackConfiguration -WriteBackEnabled $false

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 35863b41-f4b7-a772-b9d7-119b8eb08830
Version Independent ID: 2db4eafa-79cb-9401-baf6-6902a1593972
Content: Modify group writeback in Azure AD Connect - Microsoft Entra
Content Source: articles/active-directory/hybrid/how-to-connect-modify-group-writeback.md
Service: active-directory
Sub-service: hybrid
GitHub Login: @billmath
Microsoft Alias: billmath

@MGamil-MSFT
Thanks for your feedback! We will investigate and update as appropriate.

@MGamil-MSFT
Thanks for bringing this to our attention.
I'm going to assign this to the document author so they can take a look at it accordingly


Weird issue with annotations Grails 2.5.x + v 2.0.0

So I was working with Spring Security Core and Spring REST Security (Using JWT) and annotating controllers in my application (API) with the @Secured annotation with roles I had created.
I started having issues in controllers where I had a user with multiple roles, example ROLE_MANAGER and ROLE_OWNER.
If I annotated the controller with @Secured(['ROLE_OWNER']) but the UserRole object in the DB was in the order such as ROLE_OWNER was id 1 and ROLE_MANAGER was id 2, I was getting a 401 response back. If I swapped the order in the DB so now ROLE_MANAGER is id 1 and ROLE_OWNER is id 2, the access controls seem to work as expected with the annotation, even if I switch the annotation on the controller to be @Secured(['ROLE_MANAGER']) at this point.
Not sure why this is happening, or if there is a weird order thing going on, or if I am only supposed to use 1 role per user (when not using groups too).
Any help would be appreciated as I am trying to figure this out and am not having any luck yet.
I am not using GSP controlled access as the application is an API back-end that is accessed via REST.

If you can create a small test app that demonstrates the problem and upload it to your GitHub (or other online) repo, or attach here (minus the target dir, classes, etc.) I'll take a look

OK cool..I will work on a sample app in the morning and get it uploaded..I am curious as to the root of this as it is just strange.
Thanks in advance!

Hey Burt,
Sorry for the noise, was totally my bad. I wrote a check in my code to make sure the roles passed in with a JWT token match what is configured in the DB for a user (in case they get changed mid-flight). The problem was I used an equals() instead of a containsAll() call so the order played a factor between the security context, token, and what was pulled from the DB and in what order.
I will close this out.


MQTT as a first-class Source?

MQTT is a widely used means for data transport especially in the sensors/IoT domain.  It would be incredibly helpful if it could be added as a Source along with all the others that currently appear in streamz.
I have tried adding this patch manually to sources.py and it seems to work. I appreciate that more is required to make it a really useful function, but this "proof of concept" seems usable.
Would the developers be supportive of adding this type of function, or is it considered "out of scope" of the intended use of the library?
PATCH
In the header section of sources.py add:
import paho.mqtt.client as mqtt

(obviously paho-mqtt needs to be installed as a dependency.)
At the end add:
@Stream.register_api(staticmethod)
class from_mqtt(Source):
    """
    Creates events by subscribing to an MQTT data stream

    Parameters
    ----------
    host : str
        The host to listen on
    topic : str or list
        The topic, or list of topics, to listen on
    port : int
        The port to listen on (default 1883)
    start : bool
        Whether to immediately initiate the source. You probably want to
        set up downstream nodes first.
    server_kwargs : dict or None
        If given, set of further parameters to pass on to the MQTT broker

    Examples
    --------
    >>> source = Source.from_mqtt('broker.hivemq.com', 'sensor/temperature')  # doctest: +SKIP

    """

    def __init__(self, host, topic, port=None, server_kwargs=None, **kwargs):
        self.server_kwargs = server_kwargs or {}
        self.host = host
        self.topic = topic
        self.port = int(port) if port else 1883
        self.client = None
        super().__init__(**kwargs)

    def run(self):

        def on_connect(client, userdata, flags, rc):
            client.subscribe(self.topic)

        def on_message(client, userdata, msg):
            self._emit(msg.payload.decode())

        self.client = mqtt.Client()
        self.client.on_connect = on_connect
        self.client.on_message = on_message
        self.client.connect(
            self.host,
            self.port,
            self.server_kwargs.get('keep_alive', 60)
        )
        self.client.loop_forever()

    def stop(self):
        if self.client and not self.stopped:
            self.client.loop_stop()
            self.client.disconnect()
            self.stopped = True

TEST

First start publishing to the publicly accessible MQTT broker:

#!/usr/bin/env python3
import time
import random
import paho.mqtt.client as mqtt

client = mqtt.Client()
client.connect("broker.hivemq.com", 1883, 60)

while True:
    temp = random.random() * 20.0 + 5.0
    print(temp)
    client.publish("streamz/sensor/temperature", temp)  # Celcius
    time.sleep(5)

client.disconnect()

Then connect up a stream to process the data:

import time
from streamz import Stream

source = Stream.from_mqtt('broker.hivemq.com', 'streamz/sensor/temperature')
source.sink(print)
source.start()

while True:
    time.sleep(0.1)

Unfortunately, I am no longer going to be working on streaming data in the foreseeable future.
It would be really great though if someone could work on including this code (with improvements and tests as required of course).  Sources such as MQTT and AMQP are widely and extensively used in real-world applications and having these as "first class" features would help streamz gain wider adoption.  AFAIK there is no other Python library tackling this domain.


No such file or directory

No such file or directory: '../weights/deeplsd_md.tar'

Hi,
You can download the pre-models with the following command:
mkdir weights
wget https://www.polybox.ethz.ch/index.php/s/FQWGkH57UNTqlJZ/download -O weights/deeplsd_wireframe.tar
wget https://www.polybox.ethz.ch/index.php/s/XVb30sUyuJttFys/download -O weights/deeplsd_md.tar


Fix: Do not bother using array

This PR

[x] uses a string instead of an array for a list of scripts that contains only a single entry

@feelepxyz
I'm unsure why a build has not been triggered.

Thank you, @feelepxyz!


Some links on the reference page are broken in non-English languages.

Language
All non-English
What improvement are you suggesting?
Please give as much detail as possible to help us understand the change.
Some links on the reference page are broken in non-English languages.
e.g.
On https://p5js.org/es/reference/#/p5.Pulse
NG: See p5.Oscillator for a full list of methods.
NG: Extiende p5.Oscillator
-> Click on the link to open the top page of the reference.
It is probably a template issue.
So I think similar problems are occurring on other pages.
What is the expected outcome?
On non-English pages, links should contain language characters.
ttp://p5js.org/ es /reference/#/p5.Oscillator
e.g.
See p5.Oscillator for a full list of methods.
Extiende p5.Oscillator
Would you like to work on the issue?
It's difficult for me. The issue should be assigned to someone else.

Just fixed this link and while there may be some more links to fix but since there will be a new website soon, we'll keep an eye on making sure things work for that version.


Adding mods to CKAN

You don't require ksp_version when using $vref since the latter won't overwrite the former and therefor having both does nothing.
You're lacking some commas which makes the build fail.
That's what I see at once, fix it and the bot will tell us if something else is missing :)

Your identifiers cannot contain spaces. Only letters, numbers and dashs, and must start with letters. Also identifier and name of file must be the same. I recommend you set your current filenames as identifiers seeing as they look fine. Your file for Thermal Monitor lacks an "L".

Failing because filename and identifier for SemiSatura... doens't match.

Checks out! Thank you for your patience and I'm merging this now :)


Issue with Azure Search Deployment: AuthorizationFailed (403) Error

I encountered an issue while deploying Azure Search, and the deployment failed with the following error message:
ERROR: deployment failed: failing invoking action 'provision', error deploying infrastructure: starting deployment to subscription: PUT https://management.azure.com/subscriptions/xxxx/providers/Microsoft.Resources/deployments/azure-cog-search-dev-98989
**--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: AuthorizationFailed
{
"error": {
   "code": "AuthorizationFailed",
   "message": "The client<EMAIL_ADDRESS>with object id 'xxxx' does not have authorization to perform actionve authorization to perform action 'Microsoft.Resources/deployments/write' over scope '/subscriptions/xxx Resources/deployments/azure-cog-seaf-ff1f36f91cbd/providers/Microsoft.Resources/deployments/azure-cog-search-dev-1693473006' or the scope is invalid. If access was recently granted, please refresh your credentials."
}
}
--------------------------------------------------------------------------------**
azd version: 1.2.0
I have a few questions to ask regarding the necessity of write permissions. Specifically, what is the exact reason for requiring write permissions? I already have existing resources, such as GPT-4 and an embedding model. Would it still be necessary to grant write access?, and if i want to run locally in my pc, does it still require write access?

The Bicep files in the infra folder currently require that you have permissions to create a resource group and also assign various roles. If you do not have enough permissions to run azd up, then you could create each resource manually and set the required environment variables.
AZURE_FORMRECOGNIZER_RESOURCE_GROUP=""
AZURE_FORMRECOGNIZER_SERVICE=""
AZURE_LOCATION=""
AZURE_OPENAI_CHATGPT_DEPLOYMENT=""
AZURE_OPENAI_CHATGPT_MODEL=""
AZURE_OPENAI_EMB_DEPLOYMENT=""
AZURE_OPENAI_RESOURCE_GROUP=""
AZURE_OPENAI_SERVICE=""
AZURE_RESOURCE_GROUP=""
AZURE_SEARCH_INDEX=""
AZURE_SEARCH_SERVICE=""
AZURE_SEARCH_SERVICE_RESOURCE_GROUP=""
AZURE_STORAGE_ACCOUNT=""
AZURE_STORAGE_CONTAINER=""
AZURE_STORAGE_RESOURCE_GROUP=""
AZURE_SUBSCRIPTION_ID=""
AZURE_TENANT_ID=""
You can check app.py to see how these environment variables are used. Unfortunately quite a few are needed, and you also need prepdocs.py to be able to create the search index and data.
You might have more success using this other Chat on Your Data solution instead:
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data
That corresponds to this repo, but can be deployed entirely in the Portal:
https://github.com/microsoft/sample-app-aoai-chatGPT/

Closing this as a duplicate of https://github.com/Azure-Samples/azure-search-openai-demo/issues/4 but please let us know if you have further questions.

Oh, hello @pamelafox , thank you for the explanation. I apologize for not realizing there was an existing duplicate issue.
I have a few questions to ask.
The first one is: when we use the 'azd up' command, which file gets executed first and how does the execution flow? Could you provide a brief overview of the process? I am familiar with how the backend works but I am interested in understanding this from a more programming-specific perspective.
My next question is, only after all the resources are deployed can I run it locally, correct? Or, is it the case that I need to deploy all resources and require write permissions only for the Azure web app?

@Kunal1505 I've added a description of azd up here:
https://github.com/Azure-Samples/azure-search-openai-demo/pull/602/files
Re free trial: $200 should be enough for an initial deploy. I think a recent colleague estimated theirs at $15/day, mostly in Cognitive Search. But let us know if you get permission issues around what you can provision on the free trial. You may need to modify the Bicep.

FYI: We've clarified on the README that at the minimum, you need the RBAC role to run azd up, or the RBAC role scoped to an existing resource group: https://github.com/Azure-Samples/azure-search-openai-demo#azure-account-requirements
We're interested to hear if your employers are able to give you that level of access (especially resource group scoped) or if that is still high of a level of access.
I also documented in another issue how to manually assign the roles in the Portal, but I assume that will only work if you have RBAC access for that RG:
https://github.com/Azure-Samples/azure-search-openai-demo/issues/634#issuecomment-1721699823
If you cannot be granted RBAC at the resource group level, then I think the only other approach is to use keys instead of managed identity. That should be possible with changes to the credentials in app.py. We generally discourage keys when possible, however, so we haven't yet enabled that in the repo.


fetchbranches: add support for localCI

this patch add support for localCI in fetchbranches
fixes #166
Signed-off-by: Julio Montes<EMAIL_ADDRESS>

lgtm

lgtm


arangorestore just fail reloading data for this specific export

my environment running ArangoDB
I'm using the latest ArangoDB of the respective release series:

[X] 3.3

Mode:

[X] Single-Server

Storage-Engine:

[X] rocksdb

On this operating system:

[x] Linux

[X] docker - official docker library

[X] MacOS, version:

The issue can be reproduced using this dataset:
cat.tar.gz

Hi @solisoft,
Thank you for reporting the issue. I tried restoring the given dataset with the version 3.3.4 and it turns out that the restoration works fine both on Linux and Windows.
Can you please share the error log, commands and the version that you are using for restoration?
Thanks.

The command I ran on my mac (and my linux) was
arangorestore --input-directory thebrane --server.database thebrane2 --overwrite true
The log are :
Please specify a password:
Database name in source dump is 'thebrane'
Server version: 3.3.4
# Connected to ArangoDB 'http+tcp://<IP_ADDRESS>:8529'
# Re-creating edge collection 'categories_path'...
# Loading data into edge collection 'categories_path'...
2018-03-17T15:34:23Z [24592] ERROR internal error: got invalid response from server: Error reading from: 'http+tcp://<IP_ADDRESS>:8529' 'timeout during read'

Hi @solisoft,
Thank you for the commands and error log. After trying restoration with --overwrite the error is now reproducible. The restoration takes a long time( ~40mins ) for a dump of 33MB. We will further analyze this issue with the dataset that you have provided.
Thanks.

Is there any Update on this issue?

Sorry I will look at this today

Hey, I am really sorry about taking so long for this.
It seems your data is generating an error while importing: unique constraint violated - in index 15785406 of type rocksdb-skiplist over [\"_from\",\"_to\"]; conflicting key: 84909169"
Not sure why it is not shown to you directly, I will investigate

For the meantime try specifying --batch-size  65536 or something like that, this should help a little

Hi @solisoft ,
Did you have a chance to restore the dataset using the workaround suggested by graetzer?

try specifying --batch-size 65536 or something like that, this should help a little

Thanks!

Sorry, didn't get time yet :/

Hi @solisof
Just sending a quick followup - how everything is going?
Does the suggested workaround works for you?
Best,

Hi @solisoft
Could you please share with us a quick feedback on this ticket
Thanks,

I'm not sure the test will be relevant ... I made some database upgrade ...

Hi @solisoft,
are we set to close this issue, has the database upgrade fixed the arangorestore problem?

Issue is fixed (tested on 3.3.1O) Thanks


math/big: big.Int (incorrectly) marshals to a number instead of a string

I am using go version go1.11 linux/amd64, and reproduced this issue with the latest version (1.11).
Type Int on package "math/big" implements both [Un]marshalText and [Un]marshalJSON, the later just calling its *Text counterpart: https://golang.org/src/math/big/intmarsh.go?s=1964:2010#L64
According to json.Marshal and json.Unmarshal documentation, both functions are not equivalent. [Un]marshalJSON works with raw JSON types, but [Un]marshalText only with previously-unquoted strings. The documentation also says that [Un]marshalJSON has priority over [Un]marshalText.
So, with those premises, currently big.Int is being marshaled into a number, as their [Un]marshalJSON functions are being called and they don't quote the result after calling [Un]marshalText on the big.Int.
I think it should marshal into a string, as big.Float does (because it only implements [Un]marshalText). Also, other tools usually work and expect string representations for big numbers.
Here you can see the result of marshaling a struct with a big.Int and a big.Float: https://play.golang.org/p/WIILuWzr57S
Note how the Float is properly quoted and marshaled as a string but the Int isn't.
I propose doing one of the following things:

Remove [Un]marshalJSON from https://golang.org/src/math/big/intmarsh.go. According to a comment, they are only there to provide "backwards compatibility" with programs that search for those methods.
Modify big.Int's [Un]marshalJSON to quote the string it produces and unquote the one it receives, so that it mimics what json.[Un]marshal does before and after calling [Un]marshalText.
If marshaling big.Int to a number is the desired behavior, make it explicit by removing [Un]marshalText from big.Int (as in that case, they won't apply), and also make big.Float marshal to a number too.

It's not possible to change the JSON marshaling behaviour of big.Ints for Go1. Even for Go2 I'm skeptical because of the breakage this would result in.

@rsc what about the inconsistency with big.Float marshaling generating a quoted string?

If I had it to do again, I'd probably insist on big.Float having a MarshalJSON to avoid the quoting. But we missed that boat. Even for Go 2 it's not worth fixing.

ok, thanks for the explanation!


Merge prost-fork, delete previous amino_rs code

This should bring in the whole commit history of prost! (incl. the commits in my fork) and deletes the previous implementation, while still retaining our old history.
Additionally, it renames the crate to prost-amino. I think it better describes what this aims to be (but I haven't thought long about this). Previously, it was called amino for our amino_rs implementation (or prost, for @danburkert's  implementation).
We should update and shorten the Readme to explain the state of this repo, point to go-amino and to prost, too.
I think circleci only fails because prost didn't run rustfmt as we do (on circelci). I want to deviate from prost as little as possible. Hence, I propose to turn of rustfmt here :-/ (removed via https://github.com/tendermint/amino_rs/pull/12/commits/7719a4950a5c3ea89542bf2c5ac17033769eb9eb) Additionally, it doesn't run clippy (removed via https://github.com/tendermint/amino_rs/pull/12/commits/4e4e910808e046b3f7e2750a00ab549fd4aa6999). Tests still fail on circelci (but pass locally).
After this gets merged we need to update the Cargo.toml in the kms to point to this crate instead of my fork.
related to https://github.com/tendermint/kms/pull/38
closes https://github.com/tendermint/amino_rs/issues/11

Do you see any action items left on this @zmanian?

@Liamsi merge if you think you are ready

There is still plenty of work to be done but I think it's reasonable to merge this. It is more complete to what we have in amino_rs now. I'll open a bunch issues for what still needs to be done.


[Bug]: Couldn't share to Instagram

Platform
ipad 16.3
Plugin
share_plus
Version
7.0.2
Flutter SDK
3.7.12
Steps to reproduce
i get this error when i want to share to instagram on my ipad. (no problem on android)

I also want it to appear like below when posting on Instagram.

Does anyone have an idea? Thanks
Code Sample
Share.shareFiles(
          [imagePath],
          subject: product.productName ?? "",
          text: product.productUrl ?? "",
          sharePositionOrigin: positionOrigin(isIpad),
        );

Logs
[+8018 ms] [NSExtension] Extension request contains input items but the extension point does not specify a set of allowed payload classes. The extension point's NSExtensionContext subclass must
implement `+_allowedItemPayloadClasses`. This must return the set of allowed NSExtensionItem payload classes. In future, this request will fail with an error.

Flutter Doctor
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 3.7.12, on macOS 13.3 22E252 darwin-arm64, locale tr-TR)
[!] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/macos#android-setup for more details.
[✓] Xcode - develop for iOS and macOS (Xcode 14.3)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2022.2)
[✓] IntelliJ IDEA Ultimate Edition (version 2022.1.3)
[✓] VS Code (version 1.78.2)
[✓] Connected device (4 available)
[✓] HTTP Host Availability

! Doctor found issues in 1 category.

Checklist before submitting a bug

[X] I Google'd a solution and I couldn't find it
[X] I searched on StackOverflow for a solution and I couldn't find it
[X] I read the README.md file of the plugin
[X] I'm using the latest version of the plugin
[X] All dependencies are up to date with flutter pub upgrade
[X] I did a flutter clean
[X] I tried running the example project

I attempted to share a content and link on Instagram, but encountered an error stating, "Can't send media - Try copying and sending the link instead."
Could someone assist me in sharing text and a link through the Instagram iOS app?

I attempted to share a content and link on Instagram, but encountered an error stating, "Can't send media - Try copying and sending the link instead."
Could someone assist me in sharing text and a link through the Instagram iOS app?

I've test with other dependencies but it didn’t work.
https://pub.dev/packages/social_share
https://pub.dev/packages/share
https://pub.dev/packages/share_plus
https://pub.dev/packages/flutter_share_me

Bump! I need this as well. Not being able to share a single image to instagram is a bummer. I would love this to be made available! Thank you :)

Any update on this?

It is not a bug of plugin, but issue artificially created by Meta for their shitty apps.

i finally solved this issue ..  this issue is instagram consider image and text caption as multibale image and can't share it due to instagram issue .. to solve , let's consider i have function to share image :
_shareSheet(File file) async {     try {       await Share.shareXFiles([XFile(file.path)], text: "Sayed");      } catch (error) {        return;     }   }
to solve issue
code should be  :
_shareSheet(File file) async {     try {       await Share.shareXFiles([XFile(file.path)], text: null);      } catch (error) {        return;     }   }
so , try to change
Share.shareFiles(           [imagePath],           subject: product.productName ?? "",           text: product.productUrl ?? "",           sharePositionOrigin: positionOrigin(isIpad),         );
to
Share.shareFiles(           [imagePath],           subject: null,           text: null,           sharePositionOrigin: positionOrigin(isIpad),         );

i finally solved this issue .. Issue:
Instagram considers image and text caption as multiple images, preventing successful sharing due to an Instagram issue. The original _shareSheet function was designed to share an image with a text caption. To address the problem, it is recommended to modify the function as follows:
Original Function: _shareSheet(File file) async { try { await Share.shareXFiles([XFile(file.path)], text: "Mohamed El-Sayed"); } catch (error) { return; } }
Modified Function:
_shareSheet(File file) async { try { await Share.shareXFiles([XFile(file.path)], text: null); } catch (error) { return; } }
This change ensures that when sharing an image, no text is included, resolving the issue with Instagram's interpretation.
Additionally, there's a recommendation to update the usage of Share.shareFiles in the code. The original usage: Share.shareFiles( [imagePath], subject: product.productName ?? "", text: product.productUrl ?? "", sharePositionOrigin: positionOrigin(isIpad), ); Should be updated to:
Share.shareFiles( [imagePath], subject: null, text: null, sharePositionOrigin: positionOrigin(isIpad), );
This change aligns with the modified _shareSheet function, ensuring that no text is shared along with the image.
Please review and consider implementing these changes to address the Instagram sharing issue.

You available for hire?

Meistro77

Instagram Story posting don't work but resolved other issues. Thanks

how to then use the same share to share to messenger apps with link? Is there any way around this or do i need to build my custom UI sharing.
If instagram: text null
If other: product URL

how to then use the same share to share to messenger apps with link? Is there any way around this or do i need to build my custom UI sharing. If instagram: text null If other: product URL

I was thinking we need a way to be able to determine which social media platform we are sharing to and what type of share it is? Like for example, I noticed if we want to share to Instagram, but share as a story, we have to add in the text. If we want to share to instagram as a story or post, we have to remove the text. Though this isn't ideal, we should be able to do all of them in one shot, and use the text if it's a reel


long_running.cpp: Boost Asio Equivalent

Hello,
I was wondering if there is a boost asio based equivalent to the semaphore solution you created here?  I am currently trying to develop a webserver with a main io_ctx using 5 threads and a worker threadpool of N threads for handling blocking work. The goal would be for the main io_ctx which runs the webserver to within the coroutine send work to the worker threadpool and await for it to finish and then continue along in the main io_ctx to finish the work. That way the blocking work doesn't slow down the main io loop. I have been trying to go through the boost docs, but I have been struggling with finding what I am looking for and was hoping you could point me in the right direction or provide some assistance.
Thank you again for everything you have done for the open source community. I just graduated University recently and wanted to give my idea a try before going to get a traditional job. This project I am working on would not be possible without you and the other developers who maintain boost and other libraries.

Sending work to the thread pool:
// given:
// ioex = strand of executor of io_service
// wex = executor or thread pool

// assume we are on the io executor at this point:
asio::ip::tcp::socket& stream;
beast::flat_buffer& rxbuf;

auto req = http::request();
auto rxsize = co_await http::async_read(stream, rxbuf, req, asio::use_awaitable);

auto resp = http::response();
// this is a suspension point - other IO work will continue while perform_work is running on the thread pool
co_spawn(asio::make_strand(wex),
                 perform_work(req, resp),
                 asio::use_awaitable);
// perform_work is now complete, our response has been filled in
co_await http::async_write(stream, resp, asio::use_awaitable);

// query processed

Note that in general, using more than one IO thread is unnecessary, and is often counterproductive unless you have specialised hardware. The network card is a mutex, and sending data over the write is likely to take longer than the CPU takes to co-ordinate sending and receiving it.

Thank you so much for your response and time!
In your note, you mentioned that using more than one IO thread is unnecessary. How would you suggest handling blocking work on the io_ctx then? I am definitely open to suggestions. My design as of now is:

My main io_ctx has N threads for the network heavy workload
My threadpool has M threads where M >> N for blocking synchronous work (using ancient DB API's for example).

I use the standard co_ssl boost server (slightly modified for URI parsing etc). Then in the handle_request call I am planning on doing what you illustrated above calling co_spawn on the threadpool seperate from the threads I dedicated to my IO.
By more than 1 IO thread being unnecessary, do you mean that my design should be:

My main io_ctx has N=1 thread for the network workload.
My threadpool has M threads where M >> N for blocking synchronous work (using ancient DB API's for example).

yes you offload the work from the io_ctx onto the threadpool.
Richard's examples with co_spawn will executor the awaitable on the wex and then dispatch the result back to the original executor. So you await it from the io_ctx. You don't even need the strand if it's just one awaitable.
so basically;
asio::awaitable<string> heavy_work(std::string data); //will run on the thread_pool

// co_spawn this on the io_ctx
asio::awaitable<void> single_io_op(asio::ip::tcp::socket & sock, asio::thread_pool & tp)
{
    //pseudo code for simplicity sake
    auto data = co_await sock.async_read();

    // this will block this coro, but io_ctx can do other work on other connections
   auto res =  co_await co_spawn(tp, heavy_work(data), asio::use_awaitable);
   co_await sock.async_write(res);
}

The problem is that I am compiling with C++ 14 as I need access to some URL parsers etc. and other libraries so I do not have access to co_await which is only for C++20.

Solved the problem with coroutines and upgraded other libraries.


[SW-701] clientWidth issue fix

comment name should be changed
remove [SW-701] from title, it is not fixing the explained there issue

Get this error from console when switching from main to testnet:

LGTM


Rejected claim can be approved + claim being approved at 0 value

Found a rejected claim, clicked approve at the bottom (kept the status of the visit conf and receipt as rejected), claimant then gets an approval email stating a zero value on the approval.
We need to remove the 'approve, request, reject' buttons once a claim has been fully rejected to 'close' the claim

Moved to internal web issues


Topic recognition: (46445010) Task 7: VQVAE for HIPMRI prostate cancer image reconstruction.

Author: George Reid-Smith
Project: Implements, trains, and runs inference on a VQVAE model that reconstructs HIPMRI prostate cancer images through encoding, quantization, and decoding.
The model training is designed to encode input images into a high and low layer, then match encoded variables at these layers  to vectors in a learned discrete codebook, before reconstructing the image with using these vectors with decoders. This project provides the details on how to train and run inference on the model and provides a model training example that reconstructs images with structured similarity of ~75%.
Several suggested improvements have been included to further the performance of the model.
Structure:
README.md - project outline, model architecture, execution instructions, example inputs and outputs, further work recommendations.
config/ - configuration files for model parameters and directories.
logging/ - outputs of training and inference.
models/ - best model (up to SSIM) after a training execution.
samples/ - generated images from training and inference.
visuals/ - model architecture figures and training plots.
dataset.py - Custom Dataset and Dataloader classes for the HIPMRI dataset.
metrics.py - Methods for loss and ssim calculations.
modules.py - All torch modules for the VQVAE.
predict.py - Script to run inference on the model.
train.py - Script to run model training.
utils.py - General utilities for setup, configuration, and saving outputs.
requirements.txt - dependency versions for the project.

Recognition problem: VQVAE on HipMRI ---- Hard Difficulty

Algorithm solves the problem:
Very clear and resembling reconstructed images, with an SSIM over 0.7 (5 Marks)

Algorithm demonstrated and functions: (3 Marks)

Design:
Highly modularized design and good programming practice using utils script (1 Mark)

Commenting:
Sufficient docstrings and detailed comments (1 Mark)

Algorithm above Normal Difficulty: (5 Marks)

Algorithm is Hard difficulty: (5 Marks)

Suggestions:

You could be a bit more specific in describing the training process by including some key hyperparameters and tuning ---- similar to how you justified the batch size (e.g. why you ended up choosing LR of 3e-5, what else you had attempted to improve the performance and what were their implications);
Images not shown properly on README.md due to incorrect path configuration;
Very good project!

Your report covers all necessary aspects of the VQVAE implementation, training process, and evaluation. You've made good decisions on model architecture, pre-processing, and reproducibility.
A small area of improvement could be around your pull request. It can be more descriptive about the project's specific details. But good job overall.

Provided greater detail on the "details of the project" as recommended.

Feedback marks possible +2 if the requested changes are made (see above).

Good work!


Create single binary release

Feature Description
To make installing easier, it would be nice if you could offer releases which include downloads of single binaries for all interesting OS and archs.
Goal of Feature
A lot easier install experience: download release, unpack, add to path, done
Current Solution
run the npm cli, but this requires an install of npm
Are you interested in contributing this feature?
I've experience with automating releases (mainly on python and with github actions). I do not have experience with creating single file binaries from java script projects :-(

This is a really good idea.
Not the first time users have found install tricky / laborious.
https://github.com/evidence-dev/evidence/issues/448


Add description, defaults to node option

Replace TODO in node option description with comment description, links, default configs, and value options per config item.

Corrected bad docs link as per @skipjack 's notification.

Build has passed with corrected changes. If approved, this is ready for merge.


[Feature] Layers within the layer group list should be reorderable

Is your feature request related to a problem? Please describe.
The order of layers in the layer list matters, as it defines which layer is visualised above which in the canvas. The order can be changed by drag and drop action.
Describe the solution you'd like
The layer group list should behave like the layer list in this aspect, with the addition that one can drag and drop an entire group up and down the layer group list.
Describe alternatives you've considered
\
Additional context
Thanks to @Czaki for pointing this out at today's community meeting.

I've added this to the end of https://github.com/brainglobe/napari-experimental/issues/9, for now at least.

Duplicate of #9


azd Appservice Template updates

Updates azd App Service template to match those from Azure-Samples repo.

@jacksonkays can we get this change merged in?


Delete button in code mode respects realm permissions

This PR updates the delete button that appears in code mode so that it respects the realm permissions of the realm that the file comes from. Additionally, as a convenience, we add the RealmResource to the FileResource so that if you have a file resource you can also tell whether or not the file is readable/writable.

the realm DOM tests that were failing on me revealed a really fascinating issue with the way we were creating realm sessions. the realm DOM tests were driving the app in such a way that it was creating multiple realm sessions for the same realm at the same time, and as a result a race condition was created around the auth challenge/response, where sometimes the challenges stomped on top of one another and the client was responding to an old challenge. I'm adding logic to cache inflight auth requests so that we don't create race conditions around realm session creation


How to use setCenter (x: number, y: number)?

Hello,
May I know how to use this function? Where should I call the provider? I am trying to set the center to (0,0). Sorry for this silly question, I am new to ionic and angular:)
Thanks.

You need to import the provider and use this when you want to change the center of zoom manually. For example, I am with zoom in point A and have button see point B when user click on it, the zoom center goes to point B(this is just an example you will need to find the X and Y of point B).
import { ZoomAreaProvider } from 'ionic2-zoom-area';

...
constructor(public zoomAreaProvider: ZoomAreaProvider) {
}

goToPointB() {
    this.zoomAreaProvider.setCenter(100, 200);
}
....

Hi Leonardosalles,
Thanks for the reply. I managed to implement the pitch and zoom feature.^^
I have another question on how to make the context scrollable? Before I insert  to the html, the page is scrollable, but after I insert , the page cannot be scrolled when the page is loaded. It is scrollable only when I pitch and zoom the content.
Following are the snippet of the html code:

{{'Topic 1.1 What is diabetes?' | translate}}

      • Diabetes is a chronic medical condition in which a person has high blood sugar.

 • Insulin is the hormone produced by the pancreas. It allows glucose move from the blood into the cells where it can
      be used as energy.

 • People with diabetes either do not make enough insulin (Type 1 Diabetes), or the insulin they make does not work
      properly (Type 2 Diabetes). As a result, the glucose stays in the blood and increases over time.


Label macro options are not documented for text input

The text input component mentions a label object, but does not give details of the macro options. I expect these are similar to the GOV.UK design system's options.

I'm seeing this in the Nunjucks options table, which links to the label options, are you not?
Label - Object - Required. The label used by the text input component. See label.

My mistake, I meant to raise this on the NHS Frontend library, not here 🤦


Stream data into Azure Databricks using Event Hubs - Programming Documentation Incorrect

[ Programming Documentation Incorrect ]
In Send tweets to Event Hubs - Programming Code
val eventHubClient = EventHubClient.createFromConnectionString(connStr.toString(), pool) - Code is Wrong
It should be come like this,
val eventHubClient = EventHubClient.create(connStr.toString(), pool)

Document details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fd4b0492-b73e-881d-92ef-a9e9d841cd05
Version Independent ID: 3ca1bc50-7003-0766-b14e-a96b100516da
Content: Tutorial: Stream data into Azure Databricks using Event Hubs
Content Source: databricks/scenarios/databricks-stream-from-eventhubs.md
Service: azure-databricks
GitHub Login: @lenadroid
Microsoft Alias: alehall

@ammy-b -
Thanks for brining this to our attention. We will investigate it further and update you shortly.

#label:"doc-bug"

Thanks for providing feedback that helps improve our documentation. This issue has been resolved and the outdated content has been removed. We are closing the issue.
#please-close

#please-close


Fix nodejs install for install-dev-osx.sh

Sending the npm tarball directly to tar and using --strip-components causes npm to not be properly installed.  This means the test dependencies are installed using the system npm, polluting the systems node_modules.  Not sure why tar doesn't work, possibly due to symlink.  Reverting to temporary directory method with this PR.
Review Checklist

Tests were added to cover all code changes
Documentation was added / updated
Code and tests follow standards in CONTRIBUTING.md

That does not make sense to me. Isn't it just that $VIRTUAL_ENV is undefined and we don't have set -u to save us?
Maybe we should turn on set -u after activating the virtualenv?

It doesn't make sense to me either.  We do activate the virtualenv prior to this, on line 56.  set -u afterwords still a good idea.

I guess the only answer is I had an old runtime/ folder, I removed it and re-ran on master and it worked /facepalm


power: stm32wb: support of the Low Power Mode

This patch enables the low power Mode for the stm32wb soc.
This is configured through the SYS_POWER_MANAGEMENT.
It uses the LPTIM timer as tickless timer (STM32_LPTIM_TIMER) to count the sleep period and wakeup the kernel on lptim interrupt.
The SLEEP 1,2,3 modes are supported on this device, which correspond to the stm32 STOP 0,1,2 modes.
Basically, there is a configuration maximum timeout allowed by the lptim is 2000ms when clocked by the LSE.
The Deep Sleep mode is not supported by this PR.
Signed-off-by: Francois Ramu<EMAIL_ADDRESS>

rebase and adapt on top of  https://github.com/zephyrproject-rtos/zephyr/pull/19026

remove blank line

stm32wb low power modes depends on the CONFIG_SYS_POWER_MANAGEMENT

move the
config STM32_LPTIM_TIMER
bool
default y
depends on SYS_POWER_MANAGEMENT
from soc/arm/st_stm32/common/Kconfig.defconfig.series to soc/arm/st_stm32/stm32wb/Kconfig.defconfig.series

Sanitychek failure: ' Sanitycheck / qemu_arc_hs:tests/portability/cmsis_rtos_v1/portability.cmsis_rtos_v1 / tests/portability/cmsis_rtos_v1/portability.cmsis_rtos_v1'

rebase


How do you specify the file and template under the usage section?

Some sort of example would be helpful

Hi!
Here's an example for i3wm:
[[item]]
file = '~/.config/i3/config'
template = 'i3'
subtemplate = 'colors'
hook = 'i3-msg reload'
rewrite = false

Just make a [[item]] for each file you want, then specify the file and template (optionally subtemplate too) with file, template and subtemplate keys.
If you want a list of schemes and templates, take a look at the base16 repo.

Here's how config.toml looks like in my dotfiles: https://github.com/Misterio77/dotfiles/blob/master/home/.config/flavours/config.toml

Closing this as an possible documentation improvement, centralized in #11.
Let me know if you need any more help


tcmu-runner auto restart when timeout and unfound targets.

Hello!

tcmu version: tcmu-runner-1.4.0

Linux version & kernal version: CentOS7.7.1908  kernel 3.10.0-1127

Ceph version: 13.2.8 minic
272 OSD in 8 storage nodes
32 rbd-volumes(LUNs) in 8 clients; 8 gateways(1 client log in 1 gw); 1targets

cluser IO:
650MB/s  1K IOps write

What I do
To simulate pg inactive as well as watching the relative changes in cluster IO and iscsi LUN.

What I expected to see
LUN time out -> dissconnected -> re-login
BUT, what didn't perform as expected:
(1).Some tcmu-runner service seems restart after timeout.(4/8 tcmu-runner service were restarted.)

(2).Cannot discovery target using gateway IP:port (see e.g)

e.g:
The vm-node11(client) was connected to <IP_ADDRESS>:3260,but after the tcmu-runner auto restart, the vm can't discovery targets from command. ----iscsiadm -m discovery -t sendtargets -p <IP_ADDRESS>:3260
Command out put on client：

Appendix：
Last 25 lines log for tcmu-runner at <IP_ADDRESS> :

25970 2021-07-26 14:47:10.815 1825526 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-11-1: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
25971 2021-07-26 14:47:10.826 1825526 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-11-2: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
25972 2021-07-26 14:47:10.840 1825526 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-11-3: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
25973 2021-07-26 14:47:10.840 1825526 [INFO] alua_implicit_transition:569 rbd/rbd.xxx30T-11-1: Starting lock acquisition operation.
25974 2021-07-26 14:47:10.848 1825526 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-11-4: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
25975 2021-07-26 14:47:10.849 1825526 [INFO] alua_implicit_transition:569 rbd/rbd.xxx30T-11-2: Starting lock acquisition operation.
25976 2021-07-26 14:47:10.857 1825526 [INFO] alua_implicit_transition:569 rbd/rbd.xxx30T-11-3: Starting lock acquisition operation.
25977 2021-07-26 14:47:10.865 1825526 [INFO] alua_implicit_transition:569 rbd/rbd.xxx30T-11-4: Starting lock acquisition operation.
25978 2021-07-26 14:47:10.921 1825526 [WARN] tcmu_rbd_lock:757 rbd/rbd.xxx30T-11-1: Acquired exclusive lock.
25979 2021-07-26 14:47:10.927 1825526 [WARN] tcmu_rbd_lock:757 rbd/rbd.xxx30T-11-2: Acquired exclusive lock.
25980 2021-07-26 14:47:10.997 1825526 [WARN] tcmu_rbd_lock:757 rbd/rbd.xxx30T-11-4: Acquired exclusive lock.
25981 2021-07-26 14:47:11.013 1825526 [WARN] tcmu_rbd_lock:757 rbd/rbd.xxx30T-11-3: Acquired exclusive lock.
25982 2021-07-26 14:53:21.238 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25983 2021-07-26 14:53:21.238 1825526 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-11-3: Handler connection lost (lock state 1)
25984 2021-07-26 14:53:21.239 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25985 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25986 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25987 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25988 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25989 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25990 2021-07-26 14:53:38.087 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25991 2021-07-26 14:53:38.093 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25992 2021-07-26 14:53:38.097 1825526 [INFO] tgt_port_grp_recovery_thread_fn:245: Disabled iscsi/iqn.2021-04.com.fixxxxxxe.iscsi-gw:xxxtor/tpgt_7.
25993 2021-07-26 14:54:41.430 1832626 [INFO] dyn_config_start:422: Inotify is watching "/etc/tcmu/tcmu.conf", wd: 1, mask: IN_ALL_EVENTS
LOG END AT HERE FOR 3 HOURS.
END
Thank you for reading~

As I tried to restart the tcmu-runner at <IP_ADDRESS> it fixed.

What's your tcmu-runner.service ? Does the systemd restart it after something happen ? Do you have any logs about why the tcmu-runner crashed ?
25989 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25990 2021-07-26 14:53:38.087 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25991 2021-07-26 14:53:38.093 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.

The rbd handler will set the rados_osd_op_timeout to 30 as default, so the requests to ceph cluster will timedout if OSD couldn't response to tcmu-runner in 30 seconds. Have you checked the ceph logs ? Does there has any error ?

What's your tcmu-runner.service settings ? Does the systemd restart it after something happen ? Do you have any logs about why the tcmu-runner crashed ?
25989 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25990 2021-07-26 14:53:38.087 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25991 2021-07-26 14:53:38.093 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.

The rbd handler will set the rados_osd_op_timeout to 30 as default, so the requests to ceph cluster will timedout if OSD couldn't response to tcmu-runner in 30 seconds. Have you checked the ceph logs ? Does there has any error ?

The settings of tcmu-runner service as follows:
[Unit]
Description=LIO Userspace-passthrough daemon
After=network.target

[Service]
LimitNOFILE=1000000
Type=dbus
BusName=org.kernel.TCMUService1
KillMode=process
ExecStart=/usr/bin/tcmu-runner

[Install]
WantedBy=multi-user.target

I didn't found log about why tcmu-runner restart in /var/log/tcmu-runner.log. What I pasted in issue are all the logs during my test.
In ceph cluster I got one pg inactive.
In other nodes(which tcmu-runner not auto restart),I found log like this:
2021-07-26 14:47:36.555 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>352, elapsed_usec: 44276
2021-07-26 14:47:36.571 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>952, elapsed_usec: 14293
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-2: Handler connection lost (lock state 0)
2021-07-26 14:47:36.615 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>024, elapsed_usec: 30001306
2021-07-26 14:47:36.662 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.662 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 262144, data offset:<PHONE_NUMBER>096, elapsed_usec: 30000921
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-4: Timing out cmd.
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-4: Handler connection lost (lock state 0)
2021-07-26 14:47:37.343 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>792, elapsed_usec: 30000880
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-1: Timing out cmd.
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-1: Handler connection lost (lock state 0)
2021-07-26 14:47:47.418 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-1: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>520, elapsed_usec: 30000675
2021-07-26 14:47:47.419 4050954 [INFO] tgt_port_grp_recovery_thread_fn:245: Disabled iscsi/iqn.2021-04.com.xxxxxxxxx.iscsi-gw:xxxxxx/tpgt_3.
2021-07-26 14:47:47.523 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-1: HA not supported.
2021-07-26 14:47:47.601 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-4: HA not supported.
2021-07-26 14:47:47.649 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-2: HA not supported.
2021-07-26 14:47:47.649 4050954 [INFO] tgt_port_grp_recovery_thread_fn:271: Enabled iscsi/iqn.2021-04.com.xxxxxxxx.iscsi-gw:xxxx/tpgt_3.
2021-07-26 14:48:21.371 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-1: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-26 14:48:21.384 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-4: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-26 14:48:21.437 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-2: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-26 14:48:21.442 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-3: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported

I expected the gw will auto connect(log) afer disconnect by time out,  but i cant discovery or login to the gw on the node which tcmu-runner auto-restarted.
Is there something I missed to take it into account.

What's your tcmu-runner.service settings ? Does the systemd restart it after something happen ? Do you have any logs about why the tcmu-runner crashed ?
25989 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25990 2021-07-26 14:53:38.087 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25991 2021-07-26 14:53:38.093 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.

The rbd handler will set the rados_osd_op_timeout to 30 as default, so the requests to ceph cluster will timedout if OSD couldn't response to tcmu-runner in 30 seconds. Have you checked the ceph logs ? Does there has any error ?

The settings of tcmu-runner service as follows:
[Unit]
Description=LIO Userspace-passthrough daemon
After=network.target

[Service]
LimitNOFILE=1000000
Type=dbus
BusName=org.kernel.TCMUService1
KillMode=process
ExecStart=/usr/bin/tcmu-runner

[Install]
WantedBy=multi-user.target

I didn't found log about why tcmu-runner restart in /var/log/tcmu-runner.log. What I pasted in issue are all the logs during my test.

Are you using container or something else ? I know in some container envs the container service will detect the tcmu-runner service's status, if it's dead the container will try to pull it up.
As default the tcmu-runner itself won't auto-restart by systemd service, so I am curious how this could happen for you ?

In ceph cluster I got one pg inactive.
In other nodes(which tcmu-runner not auto restart),I found log like this:
2021-07-26 14:47:36.555 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>352, elapsed_usec: 44276
2021-07-26 14:47:36.571 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>952, elapsed_usec: 14293
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-2: Handler connection lost (lock state 0)
2021-07-26 14:47:36.615 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>024, elapsed_usec: 30001306
2021-07-26 14:47:36.662 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.662 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 262144, data offset:<PHONE_NUMBER>096, elapsed_usec: 30000921
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-4: Timing out cmd.
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-4: Handler connection lost (lock state 0)
2021-07-26 14:47:37.343 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>792, elapsed_usec: 30000880
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-1: Timing out cmd.
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-1: Handler connection lost (lock state 0)
2021-07-26 14:47:47.418 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-1: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>520, elapsed_usec: 30000675
2021-07-26 14:47:47.419 4050954 [INFO] tgt_port_grp_recovery_thread_fn:245: Disabled iscsi/iqn.2021-04.com.xxxxxxxxx.iscsi-gw:xxxxxx/tpgt_3.
2021-07-26 14:47:47.523 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-1: HA not supported.
2021-07-26 14:47:47.601 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-4: HA not supported.
2021-07-26 14:47:47.649 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-2: HA not supported.

Were you building the tcmu-runner from source ?
Why in this node the HA not supported, this usually due to you are using the lower ceph version, which doesn't support the exclusive lock, when building the tcmu-runner.
While in another node, you are building the tcmu-runner with a higher ceph version ????

What's your tcmu-runner.service settings ? Does the systemd restart it after something happen ? Do you have any logs about why the tcmu-runner crashed ?
25989 2021-07-26 14:53:21.240 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25990 2021-07-26 14:53:38.087 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.
25991 2021-07-26 14:53:38.093 1825526 [ERROR] tcmu_rbd_handle_timedout_cmd:992 rbd/rbd.xxx30T-11-3: Timing out cmd.

The rbd handler will set the rados_osd_op_timeout to 30 as default, so the requests to ceph cluster will timedout if OSD couldn't response to tcmu-runner in 30 seconds. Have you checked the ceph logs ? Does there has any error ?

The settings of tcmu-runner service as follows:
[Unit]
Description=LIO Userspace-passthrough daemon
After=network.target

[Service]
LimitNOFILE=1000000
Type=dbus
BusName=org.kernel.TCMUService1
KillMode=process
ExecStart=/usr/bin/tcmu-runner

[Install]
WantedBy=multi-user.target

I didn't found log about why tcmu-runner restart in /var/log/tcmu-runner.log. What I pasted in issue are all the logs during my test.

Are you using container or something else ? I know in some container envs the container service will detect the tcmu-runner service's status, if it's dead the container will try to pull it up.
As default the tcmu-runner itself won't auto-restart by systemd service, so I am curious how this could happen for you ?

In ceph cluster I got one pg inactive.
In other nodes(which tcmu-runner not auto restart),I found log like this:
2021-07-26 14:47:36.555 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>352, elapsed_usec: 44276
2021-07-26 14:47:36.571 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>952, elapsed_usec: 14293
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.613 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-2: Handler connection lost (lock state 0)
2021-07-26 14:47:36.615 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>024, elapsed_usec: 30001306
2021-07-26 14:47:36.662 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-2: Timing out cmd.
2021-07-26 14:47:36.662 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-2: io mod: read mode, data len: 262144, data offset:<PHONE_NUMBER>096, elapsed_usec: 30000921
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-4: Timing out cmd.
2021-07-26 14:47:37.341 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-4: Handler connection lost (lock state 0)
2021-07-26 14:47:37.343 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>792, elapsed_usec: 30000880
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_rbd_handle_timedout_cmd:1001 rbd/rbd.xxx30T-6-1: Timing out cmd.
2021-07-26 14:47:47.416 4050954 [ERROR] tcmu_notify_conn_lost:187 rbd/rbd.xxx30T-6-1: Handler connection lost (lock state 0)
2021-07-26 14:47:47.418 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-1: io mod: read mode, data len: 4096, data offset:<PHONE_NUMBER>520, elapsed_usec: 30000675
2021-07-26 14:47:47.419 4050954 [INFO] tgt_port_grp_recovery_thread_fn:245: Disabled iscsi/iqn.2021-04.com.xxxxxxxxx.iscsi-gw:xxxxxx/tpgt_3.
2021-07-26 14:47:47.523 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-1: HA not supported.
2021-07-26 14:47:47.601 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-4: HA not supported.
2021-07-26 14:47:47.649 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-2: HA not supported.

Were you building the tcmu-runner from source ?
Why in this node the HA not supported, this usually due to you are using the lower ceph version, which doesn't support the exclusive lock, when building the tcmu-runner.
While in another node, you are building the tcmu-runner with a higher ceph version ????

Thank you for replying.
The ceph cluster version is 13.2.8 in all storage nodes.
tcmu-runner was built by 1.4.0 source code
'HA not supported' occoured in "another node", which I didn't pasted yesterday.   just like:
2021-07-27 15:04:47.234 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-1: io mod: read mode, data len: 262144, data offset:<PHONE_NUMBER>568, elapsed_usec: 964577
2021-07-27 15:04:47.251 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 131072, data offset:<PHONE_NUMBER>936, elapsed_usec: 590750
2021-07-27 15:04:47.251 4050954 [INFO] tgt_port_grp_recovery_thread_fn:245: Disabled iscsi/iqn.2021-04.com.xxxxxxxxx.iscsi-gw:xxxxxxx/tpgt_3.
2021-07-27 15:04:47.396 4050954 [WARN] tcmu_rbd_check_excl_lock_enabled:796 rbd/rbd.xxx30T-6-2: HA not supported.
2021-07-27 15:04:47.396 4050954 [INFO] tgt_port_grp_recovery_thread_fn:271: Enabled iscsi/iqn.2021-04.com.xxxxxxxxx.iscsi-gw:xxxxxxx/tpgt_3.
2021-07-27 15:05:46.317 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-1: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-27 15:05:46.337 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-4: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-27 15:05:46.348 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-3: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-27 15:05:46.361 4050954 [WARN] tcmu_print_cdb_info:1193 rbd/rbd.xxx30T-6-2: a3 c 1 12 0 0 0 0 2 0 0 0 is not supported
2021-07-27 15:05:46.454 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset: 0, elapsed_usec: 93241
2021-07-27 15:05:46.489 4050954 [INFO] rbd_finish_aio_generic:1141 rbd/rbd.xxx30T-6-4: io mod: read mode, data len: 4096, data offset: 4096, elapsed_usec: 34772

What I can find on gateway node is.
[root@gateway6 ~]# netstat -anp |grep 3260
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260       <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260       <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260       <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260       <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260       <IP_ADDRESS>:*               LISTEN      -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47513    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46572    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47373    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47443    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47225    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46863    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47005    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47586    FIN_WAIT2   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47293    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46722    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46933    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46430    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:33260        <IP_ADDRESS>:7159       ESTABLISHED 3000906/ceph-osd
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47152    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:7131         <IP_ADDRESS>:33260      ESTABLISHED 2999805/ceph-osd
tcp        0      0 <IP_ADDRESS>:7157         <IP_ADDRESS>:33260      ESTABLISHED 3007121/ceph-osd
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46651    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:47081    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46504    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46351    TIME_WAIT   -
tcp        0      0 <IP_ADDRESS>:3260         <IP_ADDRESS>:46791    TIME_WAIT   -

What in client iscsid service
[root@vm-node11 ~]# systemctl status iscsid
● iscsid.service - Open-iSCSI
   Loaded: loaded (/usr/lib/systemd/system/iscsid.service; enabled; vendor preset: disabled)
   Active: active (running) since Sat 2021-07-24 11:00:33 CST; 4 days ago
     Docs: man:iscsid(8)
           man:iscsiadm(8)
 Main PID: 4459 (iscsid)
   CGroup: /system.slice/iscsid.service
           ├─4458 /usr/sbin/iscsid
           └─4459 /usr/sbin/iscsid

Jul 28 14:47:33 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:36 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:39 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:42 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:45 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:48 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:51 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:54 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:47:57 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)
Jul 28 14:48:00 vm-node11 iscsid[4458]: conn 0 login rejected: target error (03/01)

I will set "log_level = 5" in /etc/tcmu/tcmu.conf and rebuild this error


Resolve missing migration for starred datasets

Verify that there is a migration missing and add using manage.py makemigration

See #69 -- will push this comment to that issue.


Refactor metrics

Looking at the account-level metrics for PBS-Java, it's apparent that AMP requests aren't logging the same set of metrics as regular openrtb requests.
The first step is to catch up with what's being done on the Go side in https://github.com/prebid/prebid-server/pull/547 and https://github.com/prebid/prebid-server/pull/550. Then we should go beyond the Go implementation to count adapter and account requests. Also, Go
Scenarios:

openrtb (with or without stored requests)
openrtb for app (with or without stored requests)
AMP

Every request should log:

$.{ok,badinput,err}.{ortb-web,ortb-app,amp,legacy}
$.adapter.ID.requests.type.{ortb-web,ortb-app,amp,legacy}

this is https://github.com/prebid/prebid-server/issues/551

Make the following metric configurable:

$.account.ID.requests.type.{ortb-web,ortb-app,amp,legacy}

Suggested configuration:
{code}
metrics.accounts.basic: acctId1, accId2
metrics.accounts.detailed: acctId3, accId4
{code}
Where 'basic' metrics are:

account.ID.requests
account.ID.bids_received
And 'detailed' metrics are everything else:
account.ID.ADAPTER.*
account.ID.requests.type.{ortb-web,ortb-app,amp,legacy}

If either 'basic' or 'detailed' is specified in the config and an account is not in either 'basic' or 'detailed', no metrics should be logged for it.
Other changes aligning with https://github.com/prebid/prebid-server/pull/550:
requests.adapter.ID.requests.gotbids => a bid request was made and bids were returned
requests.adapter.ID.requests.nobid => a bid request was made, but no bids were returned
requests.adapter.ID.requests.badinput => a bid request was made with some invalid input
requests.adapter.ID.requests.badserverresponse => a bid request was made and the server responded with an error or something unexpected.
requests.adapter.ID.requests.timeout => a bid request was made and the bidder timed out.
requests.adapter.ID.requests.unknown => a bid request was made and some unknown error happened.

Taking advantatge of this issue I would like to ask if we could take into consideration the following :

do not track all the requests, just a %
be able to TOTALLY disable metrics

The latter could be very useful because we could launch two instances of prebid-server and just gather metrics in one of them.

be able to TOTALLY disable metrics

That's easy enough today -- just don't include the metrics section of the server config.

do not track all the requests, just a %

Which percentages? e.g. percent AMP requests? What's the goal of logging percentages -- saving metrics space? With multiple servers, percentages can't add.

It's a matter of performance although I do not configure anything the code is still being executed, and all those counters are increased for each request
About percentages ... the same reason ... performance
This week I've been at JBcnConf and you could not imagine what companies like DynaTrace are doing in order to avoid incrementing counters whenever possible, the talk was quite awesome http://www.jbcnconf.com/2018/infoTalk.html?id=33

Hi @jordillachmrf.
Since this issue is focused mostly on improvements related to what metrics to collect let's tackle your suggestion as separate issue (or maybe issues?). Please feel free to create them to start discussion.


Request: Non-minified userscript

I don't suppose you'd be willing to provide us with a version of the userscript that hasn't been minified?
Yes, users who want to make adjustments could take the time to reformat and analyze the script themselves, or just write their own from scratch, but both of those seem rather wasteful when there's already an open-source project that does 99% of what you want it to.
It's just so much easier to figure out what's what if everything has intelligible and informative names.

Bruh. I didn't really get it. Why would anyone need this when the project literally has the open source code?

Just believe me, digging through unminified Webpack exhaust is not much nicer than digging into minified one. And there's no need in it: you can just modify the sources and run npm run build, that's it.
Or better yet, you can simply create a feature request here ¯\(ツ)/¯

I suppose... as far as actual changes I might have wanted to make, I'm talking about things like changing delays or shifting offsets; it probably wouldn't make sense to include such user-specific tweaks in the upstream.
By the way, I know it's not relevant to my initial question, but is it normal for your script to hang for several seconds while loading a user's profile page if you try to scroll just after the page loads, with the old css config setting enabled?

I think, it would be much easier for you to make a fork, cause you still need to keep the script in actual state, and if you or your userscript manager will update GitHub-Defreshed, you'll just lost everything you've manually edited

is it normal for your script to hang for several seconds while loading a user's profile page if you try to scroll just after the page loads

Hm. Can not reproduce this. Could you provide an example?

With Chromium 72 Portable, using ViolentMonkey as my userscript manager.
Note first the difference in the time spent on scripting during page load.
In both cases, I immediately started using the scroll wheel on my mouse upon refreshing the page. You can see purple segments on the input graph starting to appear when the page first responds to the scroll wheel movement.

Without old css setting
![image](https://user-images.githubusercontent.com/7786502/89204585-582d8900-d584-11ea-8817-b41041dd0ac2.png)

With old css setting
![image](https://user-images.githubusercontent.com/7786502/89202985-d0df1600-d581-11ea-913d-3cf8b77d0aac.png)

@StaticPH, well, it's something really strange and case-specific, and I don't think that I can even reproduce it by myself cause I can't even find Chromium 72 Portable binaries or sources. It seems like it's an outdated version since 84-86 versions are mentioned everywhere currently.
I have a hunch that this is caused by the preloader, but it's made in pure css, which should not affect site usability at all. All that the "Use old css styles" setting does is inject an extra <style> block into the page, this shouldn't affect performance in any noticeable way. And it works fine for all popular browsers I know (from Safari to Firefox)

Try GitHub-Defreshed 2.0.5, it's currently broken a little bit, but this should help to understand if the preloader is the root of the problem.

Well, I needed a build that would preserve names of classes and functions for some debug purposes and just remembered this issue. I think this is exactly what you asked for.
I still do not understand why it's easier for you to make changes to the messy webpack build rather than to the project itself, but from now on the newest debug build will always be available here


Logging of low core confidence when FallbackAction is triggered

Proposed changes:

This PR adds some rasa_core logging information.
The core model did already log the confidence for an intent prediction if the nlu_threshold wasn't reached. Now the core model (the SimplePolicyEnsemble) will also log its highest confidence for the next action to predict if a FallbackAction would be triggered because the core confidence threshold is not reached.

In a future PR we would like to add logging information in the core_evaluation on the core_confidence as it was already done for the nlu_evaluation.
Status (please check what you already did):

[x] made PR ready for code review
[x] added some tests for the functionality
[x] updated the documentation
[ ] updated the changelog

Hi @DavidSted, I appreciate that you're improving our logging! Though, I'm not sure this is the simplest way to implement what you're trying to achieve. Is your main goal here basically to be notified when the FallbackPolicy is triggered because of low core confidence (instead of low NLU confidence)? Do we get that much out of knowing the highest confidence for another action that didn't reach the threshold, or are we just providing that information to parallel the current logging of low NLU confidence?

Hi @DavidSted, I appreciate that you're improving our logging! Though, I'm not sure this is the simplest way to implement what you're trying to achieve. Is your main goal here basically to be notified when the FallbackPolicy is triggered because of low core confidence (instead of low NLU confidence)? Do we get that much out of knowing the highest confidence for another action that didn't reach the threshold, or are we just providing that information to parallel the current logging of low NLU confidence?

Yes, the goal is to be notified when the FallbackPolicy is triggered because of low core confidence (instead of low NLU confidence). This could definitely be implemented more easier, but in addition the goal is to log the highest confidence for another action that didn't reach the threshold in that situation.
The reason or use case for that is that we want to know how insecure the core model was, when predicting a fallback policy. This information can give insight on how to change the training data to improve the whole model performance.
So in the end the goal is to log some information like this: "Highest (non fallback) core confidence X is below threshold Y. Predicting fallback action: Z"

Can you elaborate on this:

The reason or use case for that is that we want to know how insecure the core model was, when predicting a fallback policy. This information can give insight on how to change the training data to improve the whole model performance.

Keeping in mind that the highest confidence that is below a core threshold will only come from a machine-learning policy (usually KerasPolicy), not the MemoizationPolicy or FormPolicy (as they both return confidence 0 or 1)?

Well I think, a low core confidence of a machine-learning policy for a next action, even if the story is in the training data, might indicate that the model wasn't able to learn the desired behavior and the stories should eventually be changed.
Another utility of this logging information would be to see from a high confidence which is still below the core threshold, whether one just has to adjust the core confidence threshold so that more correct predictions of a machine-learning policy will be accepted.

Another utility of this logging information would be to see from a high confidence which is still below the core threshold, whether one just has to adjust the core confidence threshold so that more correct predictions of a machine-learning policy will be accepted.

I somewhat agree with your point here, although I think in order to know if you should lower your threshold, you have to also know the predicted next action, in order to know if it's correct or not.
As for your PR, I really appreciate the effort, but I don't think how we want to go about adding this information. I do think some logging in the case of low core confidence is a worthwhile addition, though, and will make sure that some gets added.