[C++] search_block may be wrong in SwissTable?

Describe the bug, including details regarding any error messages, version, and platform.
key_map.cc search_block function.
document or code may be wrong?
If I follow the parameters in the documentation, I get inconsistent results.
The reference is as follows：

https://github.com/apache/arrow/blob/main/cpp/src/arrow/acero/doc/key_map.md

Example will use input stamp 0x5E and a 64-bit status bytes word with one empty slot:
0x 4B17 5E3A 5E2B 1180.

[1 instruction] Replicate stamp to all bytes by multiplying it by 0x 0101 0101 0101 0101.

We obtain: 0x 5E5E 5E5E 5E5E 5E5E.

[1 instruction] XOR replicated stamp with status bytes word. Bytes corresponding to a matching stamp will be 0, bytes corresponding to empty slots will have a value between 128 and 255, bytes corresponding to non-matching non-empty slots will have a value between 1 and 127.

We obtain: 0x 1549 0064 0075 4FDE.

[2 instructions] In the next step we want to have information about a match in the highest bit of each byte. We can ignore here empty slot bytes, because they will be taken care of at a later step. Set the highest bit in each byte (OR with 0x 8080 8080 8080 8080) and then subtract 1 from each byte (subtract 0x 0101 0101 0101 0101 from 64-bit word). Now if a byte corresponds to a non-empty slot then the highest bit 0 indicates a match and 1 indicates a miss.

We obtain: 0x 95C9 80E4 80F5 CFDE, then 0x 94C8 7FE3 7FF4 CEDD.

[3 instructions] In the next step we want to obtain in each byte one of two values: 0x80 if it is either an empty slot or a match, 0x00 otherwise. We do it in three steps: NOT the result of the previous step to change the meaning of the highest bit; OR with the original status word to set highest bit in a byte to 1 for empty slots; mask out everything other than the highest bits in all bytes (AND with 0x 8080 8080 8080 8080).

We obtain: 6B37 801C 800B 3122,
then 6B37 DE3E DE2B 31A2,
finally 0x0000 8000 8000 0080.

[2 instructions] Finally, use leading zero bits count and divide it by 8 to find an index of the last byte that corresponds either to a match or an empty slot. If the leading zero count intrinsic returns 64 for a 64-bit input zero, then after dividing by 8 we will also get the desired answer in case of a full block without any matches.

We obtain: 16,
then 2 (index of the first slot within the block that matches the stamp).

input stamp 0x5E
block is 0x 4B17 5E3A 5E2B 1180
but i got some diffenet result.
step 1:
// document result
0x 5E5E 5E5E 5E5E 5E5E

// acutal result
0x5e5e5e5e5e5e5e00

step 2:
// document result
0x 1549 0064 0075 4FDE

// acutal result
0x1549006400754f80

The results of the following steps are not the same, so I won’t go into details here.
So, I guess there is a problem with the implementation of search_block?Especially step1 calculation.
// may be wrong???
uint64_t stamp_pattern = stamp * ((block_high_bits ^ kHighBitOfEachByte) >> 7);

Component(s)
C++

I had a look at the code and the doc. You are right that they are not consistent with each other. However, I believe they are equivalent, and they only differ in the order of instructions: The code AND with 0x 8080 8080 8080 8080 in the first step, but the doc does so in the last step. If you follow along the code till the end, you will get the same result 0x0000 8000 8000 0080 in the code.

I had a look at the code and the doc. You are right that they are not consistent with each other. However, I believe they are equivalent, and they only differ in the order of instructions: The code AND with 0x 8080 8080 8080 8080 in the first step, but the doc does so in the last step. If you follow along the code till the end, you will get the same result 0x0000 8000 8000 0080 as in the doc.

Indeed, I also ended up with consistent results


Easier nested fields on representation

Description
Auto expand "files" field on representation to it's nested fields.

I feel like this issue may be at the backend because this PR https://github.com/ynput/ayon-python-api/pull/138 seems to suffer as well. Why do we need to expand these fields?
I'd expect a query like fields={"attrib"} to mean, attrib and any of its content - and it's the same with the others. I don't understand why we need to expand these in the query itself? Is there an issue with the actual backend that we're trying to workaround?

I feel like this issue may be at the backend because this PR https://github.com/ynput/ayon-python-api/pull/138 seems to suffer as well. Why do we need to expand these fields?

I'd expect a query like fields={"attrib"} to mean, attrib and any of its content - and it's the same with the others. I don't understand why we need to expand these in the query itself? Is there an issue with the actual backend that we're trying to workaround?

Well, backend is in this case ayon-python-api. All these methods are using GraphQl to get only specific fields or to get multiple entities at the same time. REST endpoints will always return all the data, but when graphql is used you must enter the graphql query... The attribute fields is just expanded into the graphql, and because some fields are nested then we have to be explicit about the sub-fields we want to get.
query MyQuery {
  project(name: "someProjectName") {
    representations {
      edges {
        node {
          files {
            hash
            hashType
            id
            name
            path
            size
          }
        }
      }
    }
  }
}

Well, backend is in this case ayon-python-api. All these methods are using GraphQl to get only specific fields or to get multiple entities at the same time. REST endpoints will always return all the data, but when graphql is used you must enter the graphql query... The attribute fields is just expanded into the graphql, and because some fields are nested then we have to be explicit about the sub-fields we want to get.

Interesting - so graphql is unable to just retrieve the files in its complete state using something like * or alike? According to this GraphQL requires to be explicit and thus this is required for that to work.
I guess it's an unfortunate side effect of how GraphQL works. I do know that when calling it from the ayon_api I would never expect it to lack any subfields, which kind of feels like we now might need to ensure that at least the 'defaults' we expand to as subfields are actually at all times all the subfields? (Maybe requiring a test-suite, etc.?)


SAK-49896 Lessons: Page layout checklists include custom CSS

Feels like all of these backgrounds should have precedence for overriding bootstrap?
Not sure about the contrast of the --successBanner-color here but it looks a lot better than it currently is against purple.

Thanks, I didn't know that was built-in now. I tested another one with WebAim and it passed. I didn't check this one.
It looks like in dark mode it's --sakai-color-green--lighter-4 #82d2a6 on --sakai-color-green--darker-6 #022713. (8.99:1)
And in light mode it's --sakai-color-green--darker-3 #046a33 on --sakai-color-green--lighter-7 #e6f6ed. (6.02:1)

For normal texts, the minimum requirement of contrast is 4.5:1. So I think it is good enough. Thanks @jonespm


Toolbar and ToolbarButton Updated

ToolbarButton and toolbar are related to each other.
It get the colors automatically and we can change them manually.

Why we need that update in colors? What does this PR do?

Why do you store an array of pointers for colors (gColor**) when it's just used as a single length array? Perhaps you misunderstood the pointer logic? Colors are already stored as pointers, you don't need to get their address, it's unnecessary. You don't need to name the color variables as toolbarforegroundcoloaradress.

There are still few variables in gFont that uses camelCase for variable names.

Is the visual quality of the font letters good when scaling the letters up?


Update error handling

For the catch block, this would be best. JSON.stringify() can itself fail with a circular reference error on some error codes. The util.inspect doesn't.
  } catch (error) {
    if (error.response && error.response.status == 403) {
      result.push({
        color: 'danger',
        text: `:warning: *The api rate limit has been exhausted.* ${tokenMessage}`
      });
    } else {
      let util = require('util');
      let msg = util.inspect(error);
      result.push({
        color: 'danger',
        text: `:error: ${msg}`
      });
    }
  }

For the catch block, this would be best. JSON.stringify() can itself fail with a circular reference error on some error codes. The util.inspect doesn't.
  } catch (error) {
    if (error.response && error.response.status == 403) {
      result.push({
        color: 'danger',
        text: `:warning: *The api rate limit has been exhausted.* ${tokenMessage}`
      });
    } else {
      let util = require('util');
      let msg = util.inspect(error);
      result.push({
        color: 'danger',
        text: `:error: ${msg}`
      });
    }
  }

For the catch block, this would be best. JSON.stringify() can itself fail with a circular reference error on some error codes. The util.inspect doesn't.

Thanks! We are not doing JSON.stringify now and returning error.message for any unknown error. We have a further plan to extract common code to a separate lib, will implement this in the next iteration.
Other changes suggested herein have been incorporated in #234 due to foreseeable merge conflict.

For the catch block, this would be best. JSON.stringify() can itself fail with a circular reference error on some error codes. The util.inspect doesn't.

Thanks! We are not doing JSON.stringify now and returning error.message for any unknown error. We have a further plan to extract common code to a separate lib, will implement this in the next iteration.
Other changes suggested herein have been incorporated in #234 due to foreseeable merge conflict.


OTel collector agent is no longer logging all the files it has started watching

From, what I believe to be the 0.47.0 chart release, the otel agent no longer seems to log all the files it finds with the filelog receiver.
Previously, when checking the agent's logs, you would see multiple messages like:
2022-04-01T15:54:22.363Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/default_mattymo-splunk-otel-collector-agent-mmkv7_278b59aa-485d-45fe-9519-f3ad944b8122/migrate-checkpoint/1.log"}
2022-03-30T03:42:40.368Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/kube-system_calico-node-jv5kk_4f7cbaf6-a65e-4f4c-b5dc-2412eaa5a986/calico-node/0.log"}
2022-03-30T03:42:39.367Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/kube-system_calico-node-jv5kk_4f7cbaf6-a65e-4f4c-b5dc-2412eaa5a986/flexvol-driver/0.log"}
2022-03-30T03:42:36.768Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/kube-system_calico-node-jv5kk_4f7cbaf6-a65e-4f4c-b5dc-2412eaa5a986/upgrade-ipam/0.log"}
2022-03-30T03:41:39.767Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/kube-system_hostpath-provisioner-7764447d7c-qnh58_37180f7c-a795-4f13-b13c-8d657c1bb37f/hostpath-provisioner/1.log"}
2022-03-28T17:30:26.367Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/default_mattymo-splunk-otel-collector-agent-mmkv7_278b59aa-485d-45fe-9519-f3ad944b8122/migrate-checkpoint/0.log"}

Now when I deploy, I only ever see one entry in the pod logs, despite the agent sending mulitple logs and obviously monitoring more than what is seen in the info logging:
2022-04-04T18:29:53.360Z	info	file/file.go:174	Started watching file	{"kind": "receiver", "name": "filelog", "operator_id": "file_input", "operator_type": "file_input", "path": "/var/log/pods/default_mattymo-splunk-otel-collector-agent-hhpnn_6bfc4c1b-c608-4a87-b3fa-f85179c634e1/migrate-checkpoint/0.log"}

Not sure what has changed. Let me know if this should be opened directly against the collector or in the native log collection repo

Interesting. I was able reproduce this issue with v0.46.0 and v0.47.0 of the chart. v0.45.0 of the chart did not have this issue. Didn't see any changes to the chart that would have caused this directly.
From a glance, I suspect this behavior was introduced with opentelemetry-log-collection v0.25.0 or v0.26.0 or with go.opentelemetry.io/collector v0.45.0. Didn't find any indirect clues in the changelog notes for these dependencies.

Let me know if we need to open an issue against https://github.com/open-telemetry/opentelemetry-log-collection

It may be that it only logs/watches files being actively written. Was playing with the recent docker image, and when i dropped in new workloads, they did show up.

Closing for inactivity. Please reopen if the issue is still occurring.


Feature/feature gatk DoC brian

Depth of coverage from GATK.  Updated for CWL 1.0.

@mr-c ready to review


authorize_access_token breaks when request has extra query/path parameter

Describe the bug
I am using starlette integration with fastapi
In my auth endpoint I have another query parameter in my url called username which I am taking from the login endpoint
i.e
login endpoint:
    redirect = f"{req.url_for('github_auth')}/?username={req.query_params['username']}"
    return await oauth.github.authorize_redirect(req, redirect)

auth endpoint:
    token = await oauth.github.authorize_access_token(req)

However this causes an error in httpx.
It doesn't happen when username is not passed.
Path parameter isn't working either!
    redirect = req.url_for("github_auth", username=req.query_params["username"])

@router.get("/github/auth/{username}/")
async def github_auth(username: str, request: Request)

Error Stacks
Traceback (most recent call last):
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 385, in run_asgi
    result = await app(self.scope, self.receive, self.send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 45, in __call__
    return await self.app(scope, receive, send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/fastapi/applications.py", line 181, in __call__
    await super().__call__(scope, receive, send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/applications.py", line 102, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/middleware/errors.py", line 181, in __call__
    raise exc from None
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__
    await self.app(scope, receive, _send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/middleware/sessions.py", line 75, in __call__
    await self.app(scope, receive, send_wrapper)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__
    raise exc from None
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__
    await self.app(scope, receive, sender)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/routing.py", line 550, in __call__
    await route.handle(scope, receive, send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/routing.py", line 227, in handle
    await self.app(scope, receive, send)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/starlette/routing.py", line 41, in app
    response = await func(request)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/fastapi/routing.py", line 196, in app
    raw_response = await run_endpoint_function(
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/fastapi/routing.py", line 147, in run_endpoint_function
    return await dependant.call(**values)
  File "./routers/oauth.py", line 40, in github_auth
    await oauth.github.authorize_access_token(request)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/authlib/integrations/starlette_client/integration.py", line 58, in authorize_access_token
    return await self.fetch_access_token(**params)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/authlib/integrations/base_client/async_app.py", line 105, in fetch_access_token
    token = await client.fetch_token(token_endpoint, **kwargs)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/authlib/integrations/httpx_client/oauth2_client.py", line 103, in _fetch_token
    resp = await self.post(
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_client.py", line 1374, in post
    return await self.request(
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/authlib/integrations/httpx_client/oauth2_client.py", line 84, in request
    return await super(AsyncOAuth2Client, self).request(
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_client.py", line 1137, in request
    request = self.build_request(
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_client.py", line 194, in build_request
    url = self.merge_url(url)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_client.py", line 214, in merge_url
    url = self.base_url.join(relative_url=url)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_models.py", line 222, in join
    return URL(relative_url)
  File "/home/rupansh/PycharmProjects/bruh-project2/venv/lib/python3.8/site-packages/httpx/_models.py", line 71, in __init__
    self._uri_reference = url._uri_reference
AttributeError: 'NoneType' object has no attribute '_uri_reference'

To Reproduce
from authlib.integrations.starlette_client import OAuth
from fastapi import APIRouter, Request, HTTPException

router = APIRouter()
oauth = OAuth()
oauth.register(name="github", ...)

@router.route("/github")
async def github_login(req: Request):
    if not ("username" in req.query_params.keys() and req.query_params["username"]):
        raise HTTPException(status_code=400, detail="invalid_username")
    redirect = req.url_for("github_auth", username=req.query_params["username"])
    return await oauth.github.authorize_redirect(req, redirect)

@router.route("/github/auth")
async def github_auth(request: Request):
    if not ("username" in request.query_params.keys() and request.query_params["username"]):
        raise HTTPException(status_code=400, detail="invalid_username")

    token = await oauth.github.authorize_access_token(request)
    # do stuff with token

Expected behavior
The server shouldn't error out at token = await oauth.github.authorize_access_token(request)
Environment:

OS: Linux (5.7.7)
Python Version: 3.8
Authlib Version: 0.14.3

@rupansh I can't reproduce it. And you have certain errors in your code:
For query string in your To Reproduce code:
redirect = req.url_for("github_auth", username=req.query_params["username"])

This will raise error.
For your code:
@router.get("/github/auth/{username}/")
async def github_auth(username: str, request: Request)

This is not correct either, it should be:
@router.get("/github/auth/{username}/")
async def github_auth(request: Request)

Because, the request model is defined as Request.

And I have tested for query string and route path myself, it works well. I'll close this issue, because it is invalid.
If you still encounter the problem, you can reopen it. And it would be helpful if you can create a repo like one in https://github.com/authlib/demo-oauth-client so that I can test it again.


add genesiscloud to adopters

What this PR does / why we need it:
As discussed during the project meeting on Tuesday, here is our entry to the adopters list.
* Add Genesis Cloud to the adopters list

You'll need to signoff your git commit.

/ok-to-test
/retest


Rename accrediting provider to accredited provider in db schema

Context
The database schema and model code (associations) use the wrong terminology for 'accredited providers'.
Changes proposed in this pull request

[x] Migration to add a new accredited_provider_id column to the courses table and copy values from accrediting_provider_id
[x] Update model associations and other references to be consistent.

Guidance to review

Is this migration safe? By leaving the old column in place (to be removed in a later deploy) we should avoid crashes that could result from old code running on the new database. However there could be errors due to new code running before the migration completes.

Link to Trello card
https://trello.com/c/3gHEY19s/1828-rename-accrediting-provider-to-accredited-provider-in-db-schema
Things to check

[ ] This code doesn't rely on migrations in the same Pull Request - See review notes above
[x] If this code includes a migration adding or changing columns, it also backfills existing records for consistency
[ ] API release notes have been updated if necessary
[x] New environment variables have been added to the Azure config

Is this migration safe? By leaving the old column in place (to be removed in a later deploy) we should avoid crashes that could result from old code running on the new database. However there could be errors due to new code running before the migration completes.

Should we add the column in PR 1 and then the code change plus a backfill migration in PR 2?

Is this migration safe? By leaving the old column in place (to be removed in a later deploy) we should avoid crashes that could result from old code running on the new database. However there could be errors due to new code running before the migration completes.

Should we add the column in PR 1 and then the code change plus a backfill migration in PR 2?

Yes had the same thought as I was raising this PR so I've just raised https://github.com/DFE-Digital/apply-for-postgraduate-teacher-training/pull/1794
This will be PR2 as you say. PR3 can just drop the old column.

There are a few dangling references to accrediting. Some belong to the Find API and we can't fix them, some will come out in the wash when we remove the column, but should we fix the var name and test descriptions?
app/components/provider_interface/application_card_component.html.erb:23:          <%= accrediting_provider.nil? ? course_provider_name : accrediting_provider.name %>
app/components/provider_interface/application_card_component.rb:5:    attr_accessor :accrediting_provider, :application_choice, :application_choice_path,
app/components/provider_interface/application_card_component.rb:9:      @accrediting_provider = application_choice.accredited_provider
app/services/sync_provider_from_find.rb:58:    add_accredited_provider(course, find_course[:accrediting_provider])
spec/components/support_interface/provider_courses_table_component_spec.rb:47:    it 'may include accrediting providers' do
spec/support/test_helpers/find_api_helper.rb:68:                'accrediting_provider': nil,
spec/support/test_helpers/find_api_helper.rb:174:                'accrediting_provider': {
spec/support/test_helpers/find_api_helper.rb:293:              'accrediting_provider': nil,
spec/services/get_application_choices_for_providers_spec.rb:105:  it 'returns application_choice that the provider is the accrediting body for' do
spec/services/sync_provider_from_find_spec.rb:101:      it 'correctly handles accrediting providers' do

Yes I should have picked some of those up too. Have just pushed a commit to get rid of all references to accrediting except those for the Find API and legacy migrations.


CB-3542 Use virtual groups for DataLake and DataHub admin groups

@akanto pls review

Depends on #6497.


Missing filter and ordering icons

Description
I am missing the filter and ordering icons in the column header. A reset to View default and updates did not change anything.

DBeaver Version
22.3.1
Operating System
linux
Database and driver
No response
Steps to reproduce
No response
Additional context
No response

Hello @walhalla247,
Please see https://github.com/dbeaver/dbeaver/issues/18671


Guidance over status of passport-azure-ad?

Core Library
Passport Azure AD (passport-azure-ad)
Core Library Version
na
Wrapper Library
Not Applicable
Wrapper Library Version
na
Description
Hi
When we initially started looking into the feasibility of authenticating with aad from node last year I first looked at https://github.com/AzureAD/passport-azure-ad/ after following MS documentation / tutorial.
It appears that module is now living within  (or at least in the process of moving to) https://github.com/AzureAD/microsoft-authentication-library-for-js/tree/dev/maintenance/passport-azure-ad (correct me if I'm wrong! - this is a little confusing as there isn't any direct note on https://github.com/AzureAD/passport-azure-ad/ until you dig into the closed issues)
We've since experimented with the msal-node module and see from viewing the sample at https://github.com/AzureAD/microsoft-authentication-library-for-js/tree/dev/samples/msal-node-samples/ExpressTestApp that certain things, like validating tokens aren't yet done by msal-node but likely will be in the future per https://github.com/AzureAD/microsoft-authentication-library-for-js/issues/3221
Could you provide some guidance as to how long the passport module now within this repo will be supported?  There are obviously other considerations to the decision, but I find myself in a place where I'm needing to choose between using the passport library, or implementing verification based on the sample / documentation coming back to remove that once the functionality is added into msal-node, per the discussion in 3221 (a timeframe for that would also be great!)
Apologies in advance if this is all clearly stated somewhere and I've just missed it.
Many thanks
MSAL Configuration
No response
Relevant Code Snippets
No response
Identity Provider
Azure AD / MSA
Source
External (Customer)

@DevRCRun Apologies for the confusion. Yes, we are moving the passport-azure-ad codebase to this repo, and will continue to support it (no set timeline at the moment), albeit the current version is in maintenance (i.e no new features or non-critical bug fixes) while we work on providing a new solution for validating tokens and other middleware functionality based on MSAL Node.

Thanks for the reply and clarifying the documentation


How Brute Force Attack Occurs

Proposed title of article
How Brute Force Attack Occurs
Introduction paragraph (2-3 paragraphs):
A brute force attack occurs when malicious hackers use forceful attempts to break into an account and gain access to private information. Hackers use this attack to collect data or steal personal information and sell it to others. Additionally, they can use it to spread malware, phish victims, or carry out other illegal activities.
This article discusses why brute force attack is on the rise and explains how brute force attack happens. It also explains how to protect your system against such attacks.
Key takeaways:

Why brute force attack is on the rise
How brute force attack happens (Simple brute force attack, Dictionary attack, Hybrid brute force attack, Reverse brute force attack, Credential stuffing)
Examples of brute force attack
Protection against brute force attack

References:
Please list links to any published content/research that you intend to use to support/guide this article.
N/A
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

@jaykip
Good afternoon and thank you for submitting your topic suggestion.
Your topic form has been entered into our queue and should be reviewed (for approval) as soon as a content moderator is finished reviewing the ones in the queue before it.

@ahmadmardeni1 My focus is sensitizing the reader on how they may become victims of brute force attacks and how to avoid such occurrences by deploying various protection tactics.

Thank you for submitting your topic. @jaykip
But it is better to close it. We are looking for programmer-centric concepts explained in fun and intuitive ways.
Please feel free to suggest an alternate topic to explore. 🚀


Fix Javadoc for PreimageSha256Fulfillment.getEncodedPreimage

The JavaDoc for PreimageSha256Fulfillment#getEncodedPreimage is incorrect. This field has nothing todo with the OER encoding of a PreimageSha256Fulfillment (which is generated using the CryptoConditionsWriter).
Instead, this is just an attempt to help make PreimageSha256Fulfillment more immutable, because returning the actual underlying byte[] allows external actors to mutate the state of a PreimageSha256Fulfillment.

This relates to #100 and possibly to #92.

Closing this in-favor of https://github.com/ripple/crypto-conditions/issues/5


Write a shell script to create a list of all the dependencies (current and latest version)...

...Create another shell script to update the outdated dependencies and create another list.

I am assuming a file containing json data
{
"@babel/generator": "7.18.2",
"@babel/parser": "7.18.4",
"@babel/types": "7.19.0",
"chalk": "^4.1.2",
"fs-extra": "^9.1.0",
"globby": "^11.1.0",
"into-stream": "^6.0.0",
"is-core-module": "2.9.0",
"minimist": "^1.2.6",
"multistream": "^4.1.0",
"pkg-fetch": "3.5.2",
"prebuild-install": "7.1.1",
"resolve": "^1.22.0",
"stream-meter": "^1.0.4"
}
in this format
@Riyu44


Skip dependency scan via a gradle cli command?

Running a gradle task 'allTests' (kotlin-multiplatform) the dependency check is run without us actually wanting this.
I assume the task is not part of the test-group and thus not skipped.
Thus the question, can we provide a gradle argument to deactivate dep. scanning in such cases?
Thanks

Dep check isn't run as part of any other task by default in any of my gradle projects (kotlin or otherwise).
You sure this isn't something in your gradle config or some other plugin?


docs(guide): Remove redundant hint

The hint for --optimize-minimize is appearing twice in the guide to tree shaking. This change will keep the one added in 6c2ab16.

Finally Travis is ok with this branch :)
Can we merge this now?


Add second temperature to graph

The graph should include the voltage output and temperature reading from the second transistor.  This could be either combined with the first graph, or a second graph specifically for MIMO.

Plots are now handled in the main script and are configurable. The examples posted have the second heater value included.


[fix][sec] Upgrade Jetty to 9.4.54.v20240208 to address CVE-2024-22201

Motivation & Modifications
Upgrade Jetty to 9.4.54.v20240208 to address CVE-2024-22201
Documentation

[ ] doc
[ ] doc-required
[x] doc-not-needed
[ ] doc-complete

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 73.52%. Comparing base (bbc6224) to head (6fbf978).
Report is 10 commits behind head on master.

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #22144      +/-   ##
============================================
- Coverage     73.57%   73.52%   -0.05%
+ Complexity    32624    32124     -500
============================================
  Files          1877     1877
  Lines        139502   139546      +44
  Branches      15299    15312      +13
============================================
- Hits         102638   102603      -35
- Misses        28908    28968      +60
- Partials       7956     7975      +19

Flag
Coverage Δ

inttests
24.59% <ø> (+0.01%)
:arrow_up:

systests
24.21% <ø> (-0.12%)
:arrow_down:

unittests
72.80% <ø> (-0.05%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.
see 60 files with indirect coverage changes


adding status notifier

Hello, thanks for creating this lib, it's so powerful. When I use this lib, I realized the "controller.isShowing" doesn't work as expected. After some investigation, I found the controller.value would be changed multiple time for each user action. So I exposed this tooltip status. I also updated the example for your reference. Feel free to update these changes if there is better implementation. Thanks~

Hello ! Thank you for the PR
I'm curious to know more about the issue. The controller was a quick feature I implemented and I was scared it might not catch all use cases or be broken in some places. Before we get to this PR, do you mind creating an issue with the original problem and what you expect to happen? A video, call stack or a bunch of print logs would be helpful. I plan to work on this lib a lot soon in preparation for #20 so I wouldn't mind working on something like this soon

Sure.

Thank you for this PR and work ! Closing as fixed in 0.0.10


Batch Request returns 404 "Not Found"

Hi guys, I'm having a recent issue
def aggregate_response(request_id, response, exception):
    if exception is not None:
        # handle exception
        print('An exception occurred: ', exception)
    else:
        # handle response
        print('request_id is: ', request_id)
        print('response is: ', response)

def batch_processor(queryset):
    service = build('customsearch', 'v1')
    batch = service.new_batch_http_request(callback=aggregate_response)

    for result_instance in queryset:
        search_query = {
            'name': result_instance.name,
            'status': result_instance.status,
        }

        query = f"{search_query['name']} {search_query['status']}"
        # query is just a name string

        batch.add(service.cse().list(
            q=query,
            cx=os.environ.get("SEARCH_ENGINE_ID"),
            hl='en',
            lr='lang_en',
            num=3,
            sort='date',
            orTerms=search_query['name'],
            key=os.environ.get("SEARCH_API_KEY"),
        ))

    batch.execute()

I keep getting an exception:
An exception occurred:  <HttpError 404 when requesting https://www.googleapis.com/customsearch/v1?q={q}&cx={cx}&hl=en&lr=lang_en&num=3&sort=date&orTerms={orTerms}&key={key}&alt=json returned "Not Found">
However, clicking on the link https://www.googleapis.com/customsearch/v1?q={q}&cx={cx}&hl=en&lr=lang_en&num=3&sort=date&orTerms={orTerms}&key={key}&alt=json returns valid data.
I did some digging and I think the problem is related to the batch_uri / _LEGACY_BATCH_URI = 'https://www.googleapis.com/batch' (the trailing /batch) found in the googleapiclient/http.py file.
Going to https://www.googleapis.com/batch/customsearch/v1?q={q}&cx={cx}&hl=en&lr=lang_en&num=3&sort=date&orTerms={orTerms}&key={key}&alt=json returns "Not Found", however removing the trailing /batch from _LEGACY_BATCH_URI value doesn't fix it.
P.S.: This was working until recently.
Thanks.

Confirmed locally using the following:
from googleapiclient.discovery import build
#from oauth2client import file, client, tools

SE_ID = "XXXX"
SEARCH_API_KEY = "XXXX"

def aggregate_response(request_id, response, exception):
    if exception is not None:
        # handle exception
        print('An exception occurred: ', exception)
    else:
        # handle response
        print('request_id is: ', request_id)
        print('response is: ', response)

terms = ['pyramid', 'pylons']

def main():
    service = build('customsearch', 'v1')
    batch = service.new_batch_http_request(callback=aggregate_response)

    for query in terms:

        batch.add(service.cse().list(
            q=query,
            cx=SE_ID,
            hl='en',
            lr='lang_en',
            num=3,
            sort='date',
            orTerms=query,
            key=SEARCH_API_KEY,
        ))

    batch.execute()

if __name__ == '__main__':
    main()

The effective batch API URL constructed by BatchHttpRequest is:
https://www.googleapis.com/batch/customsearch/v1

This URI is NotFound, which is why the exception happens, I believe.

Hi @mcdonc, @JustinBeckwith
Thanks for all you've done so far. I'm new with these things (my first public issue ever); please what are the next steps?

@iamlordaubrey I've marked this ticket as "backend" and I hope that at some point this week or next we can escalate it to the backend team, once I figure out how to do that.  In the meantime, there isn't much you or I can do :)

Ok, thanks. Fingers crossed 🤞

This appears to be resolved. I was able to get the expected results using the script above.

Confirmed locally using the following:
from googleapiclient.discovery import build
#from oauth2client import file, client, tools

SE_ID = "XXXX"
SEARCH_API_KEY = "XXXX"

def aggregate_response(request_id, response, exception):
    if exception is not None:
        # handle exception
        print('An exception occurred: ', exception)
    else:
        # handle response
        print('request_id is: ', request_id)
        print('response is: ', response)

terms = ['pyramid', 'pylons']

def main():
    service = build('customsearch', 'v1')
    batch = service.new_batch_http_request(callback=aggregate_response)

    for query in terms:

        batch.add(service.cse().list(
            q=query,
            cx=SE_ID,
            hl='en',
            lr='lang_en',
            num=3,
            sort='date',
            orTerms=query,
            key=SEARCH_API_KEY,
        ))

    batch.execute()

if __name__ == '__main__':
    main()


Added Qriusity API

Qriusity is a quiz and trivia API.
The API is easy to use and requires no signup :)

Hi @pareshchouhan , thanks for the PR! Could you please put this entry in alphabetical order? Thanks!

okay, this is not my api that is failing.

Thanks again!


Support multiple date format placeholders for daily notes

I have set up my daily notes as Dailies/YYYY/YYYY-mm-dd. This will not work with the current od script.
It can be fixed by replacing:
date_format = date_format.replace(y_char, yyyy);

with:
date_format = date_format.replaceAll(y_char, yyyy);

TY!

Thanks! Good to know! Will patch it when I have time.

+1. My format is YYYY/MMMM/M-D-YY (ddd) which results in the note today being named m-11-yy (Sat)


"Event Access_time" panel?

I just attempted to use this component and for some reason it has a panel at the top with what appear to be buttons or links that do nothing but are labelled "Event" and "Access_time" and are causing a scroll bar to appear to the right.
What are these and how do I remove them?

Ahh...I see what is happening, this component assumes a certain icon set is being used.  I don't use that icon set.

@WhatFreshHellIsThis Did you figure out a solution to this? I'm having the same problem. Trying to avoid having to make a fork of this project.

Yes, I ran into multiple other issues and ended up writing my own composite control which was surprisingly easier than I expected using the stock vuetify date and time pickers together.


Enabling iTunes Store tracking

Is it possible to enable the option to track referrals to iTunes Store? I saw it required enabling IDFA and some other things.

Hi, this goes under campaigns doesn't it? See #30
I sadly don't have a good answer here, but it should be possible.

See https://github.com/idehub/react-native-google-analytics-bridge/issues/30#issuecomment-310279389. Closing this issue.


Fake data

I've got to the same point on many projects, where one person is working on the HTML views and/or design, and I'm on the PHP and database development.
Before there is any real data injected into documents, the designer will create duplicate elements in the page. This becomes troublesome when the markup of each repeated element is changed during the design phase, and there's unnecessary repeated work when we come to hook it up to the database.
It would be nice to see two ideas:

Simple fakery: a new attribute could be introduced similar to data-template, such as data-template-fake="5" indicating the element should be repeated 5 times.
Data-in-the-document: A comment node or something else in the document can be used to hold a representation of the data, before there is any database hooked up (or any PHP required at all). Plain-text lists of data to inject into the "fake" template elements is all that's needed.

For both approaches, it would be great to be able to bind "fake-generated" data. For example, a list of users could look like this:

Person Name

    <time data-bind:text="__fake:friendlyDate(-1 week)">1st Jan 2000</time>

The usage of __fake: -prefixed data could load randomised data from a DomTemplate-provided source. This would greatly enhance getting tangible design prototypes out the door!

I'm going to close this issue. It's a nice one to have but it's outside of the scope of this repo's responsibilities. Maybe one day it can be revisited...


Khmer Language Not Working

This Library in Khmer (Cambodia) Language not Working

Hi @BhargavSavasani ,
I've checked Khmer (Cambodia) Language and it works as expected for me.
Values folder: values-km-rKH
Locale: km_KH
Could you please elaborate on how you use the library and what goes wrong in your case? Code snippets are highly appreciated.

Hi @YarikSOffice
Please Give Any Link And Project you Work on the Khmer Language
Because Currently, my Side Not Working

@BhargavSavasani Here is a test branch for the sample app containing Khmer language:
https://github.com/YarikSOffice/lingver/compare/example_khmer_language

Hi @YarikSOffice
Please update in Sample
Because Currently still not Working
if you Update in the sample then Download and check this

@BhargavSavasani Please give me more details with code snippets/screenshots, so I can help with your issue.

@YarikSOffice
Add strings.xml file in values-km-rKH
now Setting in Change Language

Well, I don't see any issues so far. Let me figure out a few more things:

Do you call setLocale somewhere outside this class? I'm curious why do you use additional pref setting for language since you can always get the current language via lingver.getLanguage().
Do you use App Bundles?
How do you restart your app inside restartApp() method?

no i am not use app bundles
restart app is a function to restart app

@BhargavSavasani Do you use a single activity with fragments in your app? or activity per screen?
since if you are using multiple activities you have to restart all of them, but looks like your code restarts the top one only.

@YarikSOffice
But When u Call activity.finishAffinity means Restart the Full App

@YarikSOffice
please If u work khmer lang. in your project and its working
then send me full project so i am check this

the full sample project using khmer is here:
https://github.com/YarikSOffice/lingver/compare/example_khmer_language
Have you checked it out?

@YarikSOffice
but This Code not Update in Your Sample Project
If u update this Code in Sample Project then

This is a separate branch specifically for khmer language. Please check out this branch and clone/download the repository.

@YarikSOffice
ok I Got it
Thanks


Fix clippy warnings in postgres_ffi/build.rs

This PR fixes unneeded late initialization clippy warning found in https://github.com/neondatabase/neon/pull/2079.
Somehow was not found in original PR .

Thanks for checking this @SomeoneToIgnore!

So, all good, thanks for preparing us for future toolchain bump :slightly_smiling_face:

Yeah, makes sense to commit this, we'd need to do it sooner or later anyway.


nvidia_x11: i686bundled only on i686 systems

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @

Looks like this was the original intention and I somehow lost it and never had problems until now.

Don't know what happened, but the build seems to work fine now.


Is the reconstructed scene optimized when there is a loop closure?

Is the reconstructed scene optimized when there is a loop closure?

@canglangzhige , do you figure it out?

It is not. Please see voxgraph for this functionality.


Chore/489 rename helm chart

story: https://github.com/eclipse-tractusx/item-relationship-service/issues/489

fixed merge conflicts


backport: tests: keep same ceph release during handlers/idempotency test in stable-3.1

Backport of #2771 in stable-3.1

jenkins test luminous-ansible2.4-bluestore_osds_container


Addition and multiplication

The code words upon addition and multiplication of two number inputed by uset
here is the code
Number1= int(input("Enter 1st your number ="))
Number2=  int(input("Enter 2nd your number ="))
Multiply= Number1*Number2
print("Multiplied number is =" , Multiply)
Add=Number1+Number2
print("Added number is =", Add)

Please merge this

No, your PR was closed as it was spammy. You are adding unrelated code to a project. Please review the rules and values of Hacktoberfest, and understand that Hacktoberfest is about making valuable contributions to open source projects, not spamming random code in random projects.

No, your PR was closed as it was spammy. You are adding unrelated code to a project. Please review the rules and values of Hacktoberfest, and understand that Hacktoberfest is about making valuable contributions to open source projects, not spamming random code in random projects.

So what type of code you want so u can merge it

You can take a look at the open issues to see what contributions this project is looking for currently.


fix: update holesky config for new genesis

Motivation
https://github.com/eth-clients/holesky/pull/73
Description
Updates beacon chain config and bootnode enrs with values for new genesis on holesky

:tada: This PR is included in v1.11.3 :tada:

:tada: This PR is included in v1.12.0 :tada:


Resizable auto-complete pop-ups

I find the auto-complete pop-ups too small for some methods; it would be nice if there was a way to resize them (IJ has this feature, is very handy).
As an alternative UI, it could be interesting to consider a fixed pane for auto-complete. (IJ also has this feature)

I'm unable to take a screenshot of the resizable IJ pop-up (it's not capturing the pop-up decorator details or the cursor), but it is easy to show the IJ fixed pane for auto-complete:

You actually can resize the autocomplete boxes, but not the signature help box apparently (thanks, monaco).
On autocomplete/hover if you move your cursor to the edge of the box it will turn into a resize cursor. Mine worked on top and right edges.


MINOR: Fix Transient test failure SslTransportLayerTest.testNetworkThreadTimeRecorded

Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@omkreddy Thanks for the PR. Are you able to recreate this issue? It wasn't clear from the exception above if this was just idle time being too low or whether there is some other issue causing receive not to succeed and idle timeout was hit as a result.

@rajinisivaram test is consistently failing on my machine with 5 sec idle time.  I am not able to reproduce  with 10 sec idle time.


By default social login should be enabled

Bug report
Title
By default social login should be enabled
Issue Description
By default social login should be enabled
Preconditions
1. framework Version- master

Steps to reproduce
1. step1- default social login option are disabled in configuration ->customer

Expected result
As part of the core feature, all the social login should be enabled
Actual result
currently, as default social login  are disabled

[points....]

@olaysco
Thanks


bosh-lite instructions confusing

Hi there,
With reference to the 'Deploying CF and Diego to BOSH-Lite' guide:

the numbering in the guide is really confusing (lots of paragraphs are numbered '1')
it isn't clear which steps are specific to MySQL, which are general, and what you should do if you choose Postgres
when I tried to use MySQL, this step failed
'./scripts/generate-mysql-bosh-lite-manifest'
./scripts/generate-mysql-bosh-lite-manifest: line 29: /home/vagrant/cf-mysql-release/scripts/generate-bosh-lite-manifest: No such file or directory

Happy to fix things up with a PR if someone can give me some pointers.
Best wishes Ben

Hi Eric - I am indeed just trying to get a Diego-backed CF up and running on BOSH-Lite. The problem with bosh2 create-env is it appears to be breaking on Windows, since it tries to shell out to a non-existent powershell cmdlet called tar. Details posted to #cf_bosh_lite channel. Thanks Ben

Thanks, @bendalby82, looks like no one has responded yet. Since that seems like a general issue with create-env on Windows with the v2 BOSH CLI, I'd recommend asking about it in the #bosh-core-dev channel as well.
Also, the cf-deployment steps should work correctly with the (increasingly stale) BOSH-Lite Vagrant image instead of the new bosh-deployment-based BOSH-Lite, as long as you set the relevant cloud-config before deploying the manifest.
If you can get unstuck, we're also inclined to remove this BOSH-Lite documentation entirely in favor of the cf-deployment instructions.
Best,
Eric

Thanks Eric - I've added a new issue to the main bosh project, as it is quite verbose: https://github.com/cloudfoundry/bosh/issues/1821 Best wishes Ben

Thanks, @bendalby82, even better than pinging them in Slack!


EVERYTHING IS UNDER DEVELOPMENT.

          EVERYTHING IS UNDER DEVELOPMENT.

Originally posted by @farhansadikgalib in https://github.com/dishamodi0910/APIVerse/issues/452#issuecomment-2381414285

Greetings @farhansadikgalib🎀 ! , We are excited to have you dive into another issue with us!🚀
Your involvement in our project has been invaluable, and we're confident that your skills and insights will help us conquer this challenge😇.  Use command /gssoc24 to self assign the issue.  This issue represents an exciting opportunity for us to improve and enhance our project, and we are thrilled to have you on board.
We request you to follow CONTRIBUTING GUIDELINES.
Looking for your PR soon!
In case of any issues, you can contact us on Discord.❣

Hey @farhansadikgalib ! I wanted to inform you that we have closed issue.Thank you for your understanding, and we look forward to your continued engagement with our repository🤗.
In case of any issues, you can contact us on Discord.
Thank you! ❣
Happy Coding! ✨
Will See you soon❣


Site support request [carambatv.ru]

[x] I've verified and I assure that I'm running youtube-dl 2016.06.16
[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Site support request (request for adding support for a new site)

$ youtube-dl -Fv http://carambatv.ru/movie/bad-comedian/razborka-v-manile/
[debug] System config: []
[debug] User config: [u'--sub-lang', u'ru,en']
[debug] Command-line args: [u'-Fv', u'http://carambatv.ru/movie/bad-comedian/razborka-v-manile/']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.06.16
[debug] Python version 2.7.10 - Linux-4.4.12-gentoo-i686
[debug] exe versions: ffmpeg 3.0.2, ffprobe 3.0.2
[debug] Proxy map: {}
[generic] razborka-v-manile: Requesting header
WARNING: Falling back on generic information extractor.
[generic] razborka-v-manile: Downloading webpage
[generic] razborka-v-manile: Extracting information
ERROR: Unsupported URL: http://carambatv.ru/movie/bad-comedian/razborka-v-manile/
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/youtube_dl/extractor/generic.py", line 1440, in _real_extract
    doc = compat_etree_fromstring(webpage.encode('utf-8'))
  File "/usr/lib/python2.7/site-packages/youtube_dl/compat.py", line 2524, in compat_etree_fromstring
    doc = _XML(text, parser=etree.XMLParser(target=_TreeBuilder(element_factory=_element_factory)))
  File "/usr/lib/python2.7/site-packages/youtube_dl/compat.py", line 2513, in _XML
    parser.feed(text)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1642, in feed
    self._raiseerror(v)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1506, in _raiseerror
    raise err
ParseError: not well-formed (invalid token): line 27, column 121
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/youtube_dl/YoutubeDL.py", line 676, in extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python2.7/site-packages/youtube_dl/extractor/common.py", line 342, in extract
    return self._real_extract(url)
  File "/usr/lib/python2.7/site-packages/youtube_dl/extractor/generic.py", line 2140, in _real_extract
    raise UnsupportedError(url)
UnsupportedError: Unsupported URL: http://carambatv.ru/movie/bad-comedian/razborka-v-manile/

Single video: http://carambatv.ru/movie/bad-comedian/razborka-v-manile/
Single video: http://carambatv.ru/humor/golden-moustache/you_need_help/
Single video: http://carambatv.ru/?p=81985

carambatv is supported since youtube-dl 2<IP_ADDRESS>.

Doesn't work (stopped working?) on 2018.12.31. Example URL https://carambatv.ru/bad-comedian/divergent-hunger-games-in-twilight
youtube-dl "https://carambatv.ru/bad-comedian/divergent-hunger-games-in-twilight"
[CarambaTVPage] divergent-hunger-games-in-twilight: Downloading webpage
ERROR: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
~/removable_media/15G: youtube-dl --verbose "https://carambatv.ru/bad-comedian/divergent-hunger-games-in-twilight"
[debug] System config: []
[debug] User config: ['--no-playlist', '--output', '~/removable_media/15G/%(title)s.%(ext)s', '--ignore-errors']
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://carambatv.ru/bad-comedian/divergent-hunger-games-in-twilight']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.12.31
[debug] Python version 3.7.1 (CPython) - Linux-4.19.12-zen1-1-zen-x86_64-with-arch
[debug] exe versions: ffmpeg n4.1, ffprobe n4.1
[debug] Proxy map: {}
[CarambaTVPage] divergent-hunger-games-in-twilight: Downloading webpage
ERROR: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 793, in extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python3.7/site-packages/youtube_dl/extractor/common.py", line 508, in extract
    ie_result = self._real_extract(url)
  File "/usr/lib/python3.7/site-packages/youtube_dl/extractor/carambatv.py", line 99, in _real_extract
    webpage, 'video id')
  File "/usr/lib/python3.7/site-packages/youtube_dl/extractor/common.py", line 983, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.


Unable to setup ClusterSecretStore with externalSecret

Hi everyone, we have been able to set up correctly (into OCP 4.12) with no errors the environment with:

secretstore (in the namespace "support" which also contains the secret for authentication with AWS)
externalsecret in the same namespace

However, we can't set it up with "clustersecretstore". It seems like it can't read from the secret that contains the AWS credentials. In which namespace should it be?
Thanks

Can you share your ClusterSecretStore, please?

yes of course,  i think that its mandatory to have the secret containing the aws credentials in the same namespace as the externalsecret????
i wanted to avoid it in order to be available to developers who works in the namespace....

For ClusterSecretStores, you can add namespace to select which namespace to pull the secrets from. The default is the namespace of the ExternalSecret.

o great, according to the documentation there is no "namespace" option in "clustersecretstore" inside "remoteRef:
https://external-secrets.io/v0.4.3/api-clustersecretstore/
but i workssssss thanksss


New Project Proposal - InterConnect Semantic Interoperability Framework

Mission Statement
The InterConnect Semantic Interoperability Framework (SIF) is pioneering semantic interoperability without a centralized facilitator in cross domain challenges related to grids and smart homes/buildings.
Description
The InterConnect Semantic Interoperability Framework (SIF) is specified, implemented and validated in the scope of the InterConnect project (Interoperable Solutions Connecting Smart Homes, Buildings and Grids) which was funded by the European Commission as part of the Horizon 2020 work program under grant agreement number 857237. 50 partners worked on the project between 1st of October 2019 until 31st of March 2024.
One of the main challenges that the InterConnect project was tasked with was establishing and demonstrating semantic interoperability between digital systems (platforms, services, devices) from the grid/energy domain and IoT (smart buildings and homes) domain. To this end, the consortium members worked on specification and implementation of the InterConnect SIF. The SIF is realized as a set of tools, software components and validated methodologies that allow stakeholders to interconnect their semantically interoperable solutions into interoperable ecosystems. These interoperable ecosystems are the basis for developing innovative services, use cases and business models capitalizing on the semantic interoperability, knowledge dissemination and control in cross-domain setups.
A top-down and bottom-up approach were conducted for deriving requirements and identifying the best practices for the SIF. The top-down approach included analysis of reference architectures and best practices from other initiatives and previous projects. Projects like Platoon, Platone, OneNet, European IoT Platform Initiative projects (most notably Vicinity, symbIoTe and InterIoT) and initiatives like BRIDGE, FI-WARE, BDVA, IDSA and OpenDEI were carefully assessed, especially their approaches for handling intra/inter domain interoperability on syntactic and semantic levels. The bottom-up approach started with creation of the InterConnect catalogue of digital platforms brought to the project pilots by the project’s participants. Their capabilities and requirements for syntactic and semantic interoperability, knowledge sharing and semantic based control limitations and potential and security and data protection mechanisms are assessed and used as guiding requirements for SIF specification. This was necessary in order to ensure acceptance and validation at scale, first by consortium members and then by 3rd party integrators.
Based on collected requirements and identified best practices, the InterConnect project team proceeded to specify and implement the SIF as a collection of software enablers and tools namely the Semantic Interoperability Layer, the Service Store, the Generic Adapter and the P2P marketplace enablers. A set of supporting tools is also available which ease the process of achieving semantic interoperability and becoming part of InterConnect semantically interoperable ecosystems.
We started by confirming the main challenges for cross domain semantic interoperability and, in general, the main obstacles for wider adoption of semantic web technologies in the domains covered by the project:

Steep technology learning curve - It is a disruptive paradigm based on information dissemination, rather than a one-to-one data exchange approach used today by digital systems.

Agreeing business level interoperability between industrial leaders requires that the process is cost effective and risk free.

Most solution deployed, in practice, call for centralized interoperability facilitator, but that comes with a set of challenges:

Dependability on centrally hosted facilitators both technically- and business-wise;

Data needs to be processed by a 3rd party which opens new data and privacy protection risks;

Performance is dictated by capacity of the facilitating platform;

Accepting new technologies and standards depends on the facilitating platform operator;

End-to-end cybersecurity is limited by the security measures employed by the facilitating platform.
The SIF addresses these challenges and requirements in the following way:

The project enables cross-domain semantic interoperability to be established in a distributed manner among already existing digital platforms – no need for a centrally hosted facilitating platform.

Interoperability originates at stakeholder’s end, and it does not disrupt existing practices – this is achieved with the Service Adapters.

Semantic interoperability within the project is based on SAREF ontology. However, the developed enablers are ontology agnostic.

The achieved semantic interoperability enhances security and privacy protection measures by securing communication interfaces and providing integrators with means to enforce their security related best practices as well as to customize knowledge flows through selecting.

The enablers of the project can be deployed on all system levels from devices over the edge to the cloud.

Finally, semantically interoperable ecosystems provide federate knowledge spaces capable of providing answers to complex queries issued by stakeholders. This is also the basis for establishing intra and inter-domain data spaces.

The InterConnect SIF is developed as an open source software framework which includes several key software components which have their own repositories and can be even used separately from the rest of the framework. The core components are:

Semantic Interoperability Layer is based on the Knowledge Engine technology aimed at providing semantic interoperability by means of two features: translation and discovery. Both features require a common ontology. The ontology of choice for the InterConnect Interoperability Framework is SAREF together with several extensions that complete the InterConnect ontology. It is important to state that the Knowledge Engine is ontology agnostic and, in principle, able to work with any ontology if it is expressed in the RDF/OWL format. The Knowledge Engine is an open source project managed by TNO, one of three core partners behind interConnect SIF (see current leads).
Service Store is the “frontend” of the whole interoperable ecosystem built with the InterConnect SIF. The service store is conceptualized as a web service with its front-end and back-end modules and processes. The main objective is to enable building of the InterConnect ecosystem of service providers and adopters by allowing them to register new interoperable services and browse existing ones to identify services best suited for the challenge at hand and get all necessary information for accessing and properly utilizing selected services. The service store is the main identity provider for the SIF project, and it is responsible for providing trustworthiness towards integrators that the services listed in its catalogue are indeed interoperable and can be trusted for integration into semantically interoperable ecosystems. The Service Store also provides Knowledge Explorer functionality which enables visualization of the semantically interoperable ecosystems established by stakeholders. The Service Store is available for independent hosting by integrators if necessary.
Generic Adapter is a software gateway for secure and trusted communication between a service and a wider Interoperability Framework instance (including Service Store and the Knowledge Engine). The project introduced three adapter concepts. First, we have a Service Specific Adapter (SSA) where legacy interfaces and data models of the integrator’s services are mapped onto the InterConnect SIF interfacing logic and project’s SAREF-based ontology. Next, we have the Generic Adapter (GA). The GA provides unified REST API towards Service Specific Adapter. This GA REST API ensures communication with the Service Store for authentication and authorization of the service and the GA itself with the central identity provider. The GA REST API also facilitates interactions with the semantic interoperability layer (Knowledge Engine instance) by providing methods for Knowledge Base and Knowledge Interaction registration and also methods for executing corresponding knowledge exchanges. The SSA and GA combine into InterConnect Service Adapter which represent a complete semantic interoperability enabler which on the “south side” integrates with the legacy interfaces and service logic and on the “north side” exposes unified interface that all participants in the semantically interoperable ecosystem understand.
P2P marketplace enablers which are provided as deployable containers that allow pilot owners and integrators to deploy and fully manage P2P marketplace instances. The established P2P marketplaces are in full control and under jurisdiction (regulatory, market wise, data privacy protection) of the integrators. The goal was to develop enablers which would allow establishment of blockchain ledgers shared between community members and supporting community specific services for data exchange in the project pilots. The P2P marketplace enablers include Hyperledger Fabric blockchain network configurations, set of smart contracts for energy related trading and aggregation, configurable order matching engine and white labeled web application for testing purposes. This component is an auxiliary part of the InterConnect SIF.

Below is a figure showing high level architecture of the SIF.

The InterConnect SIF has been validated within 7 pilots in Greece, France, Italy, Germany, The Netherlands, Belgium and Portugal. More than 60 integrators of the framework components until now.
Is this a new project or an existing one?
Existing one. InterConnect SIF is implemented under the EU funded H2020 project InterConnect.
Current lead(s)

INSTITUTO DE ENGENHARIADE SISTEMAS E COMPUTADORES, TECNOLOGIA E CIENCIA (short INESC TEC) from Portugal represented by Fabio Coelho<EMAIL_ADDRESS>and David Rua (david.e.rua@inesctec.pt).
FONDACIJA VIZLORE LABS (short VLF) from Serbia represented by Milenko Tosic (milenko.tosic@vizlore.com).
NEDERLANDSE ORGANISATIE VOOR TOEGEPAST NATUURWETENSCHAPPELIJK ONDERZOEK (short TNO) from the Netherlands represented by Gjalt Loots (gjalt.loots@tno.nl).

Sponsoring organization(s), along with any other key contributing individuals and/or organizations
The European Commission supported the base context and provided grant for developments.
Current sponsors - INESC TEC, VLF and TNO (see the Current Leads section).
Detail any existing community infrastructure, including:

Github/GitLab, or other location where the code is hosted
Website and/or docs
Communication channels ( such as Mailing lists, Slack, IRC )
Social Media Accounts

GitLab with Wiki page: https://gitlab.inesctec.pt/groups/interconnect-public/-/wikis/home#interconnect-interoperability-framework
Page under the InterConnect project website: https://interconnectproject.eu/about/#sif
Youtube videos (within the InterConnect youtube channel): https://www.youtube.com/watch?v=2ug6t6QIE3Q
https://www.youtube.com/@interconnectproject571/videos
LinkedIn page of the InterConnect project: https://www.linkedin.com/company/interconnect-project/
Facebook page of the InterConnect project: https://www.facebook.com/InterConnectPrj/
Are there any specific infrastructure needs or requests outside of what is provided normally by LF Energy ? If so please detail them.
No at the moment.
Why would this be a good candidate for inclusion in LF Energy?

Interoperability is considered as one of the biggest challenges in the energy systems. The InterConnect SIF brings a set of open source software tools and best practices from a large scale European union innovation project that can be used by integrators from various domains to reach semantic interoperability and unlock full potential of deployed resources and services.
InterConnect SIF is focused on standard ontology from ETSI (SAREF ontology). This provides a solid basis for modeling knowledge representations and opens ways for direct standard extensions in line with the needs of the energy sector.
InterConnect SIF is a proven solution for achieving cross domain interoperability. The grid stakeholders must interoperate with stakeholders from other domains (e-mobility, IoT - Smart Homes/Buildings, Smart Cities, Smart Manufacturing etc.) in order to boost efficiency and stability of the overall system.
The InterConnect SIF software enablers can be used by other LF Energy projects to achieve semantic interoperability with a standard ontology. The SIF is ontology agnostic and other standard or best practice ontologies can be utilized.

How would this benefit from inclusion in LF Energy?

Visibility worldwide - we have good visibility within the EU and we want to expand the reach globally.
InterConnect SIF software compliance checks and validation. Improving existing and establishing missing open source software and community practices.
Securing community contributions and co-development of the key enablers, verification of the best practices and introduction of new support tools.
Cooperation with other LF Energy projects on interoperability challenges and bringing their digital solutions into the SIF interoperable ecosystem.
Under LF for Energy we seek to establish a vendor neutral project which would improve its appeal towards major integrators.
Receiving technical and market guidance from a broader group of experts and potential stakeholders.

Provide a statement on alignment with the mission in the LF Energy charter.
We are an open source project addressing interoperability challenges in cross domain setups of grids and smart buildings. This maps are well to the point 1.a) under the LF Energy Charte mission.
1.a The purpose of the Directed Fund is to raise, budget and spend funds in support of various open source and/or open standards projects relating to the generation, transmission, distribution and delivery of energy, including infrastructure and support initiatives related thereto.
What specific need does this project address?
InterConnect SIF addresses the challenge and need of interoperability among digital systems, services and devices on syntactic and semantic level. The SIF provides a framework approach so that the semantic interoperability can originate at the interface of existing services and platforms without the need for a centralized facilitator. The integrators remain in full control over the knowledge dissemination provinces and they choose with whom to establish semantically interoperable ecosystems and around which services and interfaces.
Describe how this project impacts the energy industry.
The EU and global energy market is conditioned by digitalisation. New rules and technological developments allow the proliferation of energy service providers in all markets with users having full knowledge and control over their appliances. However, interoperability represents a serious problem. Major systems are vendor locked and organized within protocol/standard siloes. There is limited interoperability within the energy sector and especially between energy sector and other sectors which put significant strain onto the overall system stability (e.g. IoT, smart homes, buildings, cities, e-mobility, smart manufacturing). Users are also seeking options to avoid vendor lock-in not just for appliances and devices but also for service providers. Only properly established interoperability on semantic level can create a truly flexible ecosystem where knowledge is disseminated and used within and between domains which would provide benefits for end users and stability and further growth for the energy system.
Describe how this project intersects with other LF Energy projects/working groups/special interest groups.
InterConnect SIF could benefit all existing LF Energy projects with a set of enablers for achieving semantic interoperability. This approach and framework can be used by all other projects within LF Energy with the need for syntactic and semantic interoperability. The existing projects could expand their services in cross--domain setups with the newly established semantic interoperability.
The InterConnect SIF project can adapt to new standards and interfacing technologies and complement existing interoperability capabilities towards a more connected ecosystem.
Who are the potential benefactors of this project?

Other LF Energy projects seeking interoperability enablers.
Manufacturers of appliances and other devices.
Service providers (grid and smart buildings).
Integrators of grid and smart home/building solutions.
Grid operators, retailers, aggregators.
Smart building operators.
EV fleet and charging network operators.
Data space initiatives and projects.
Other research projects.

What other organizations in the world should be interested in this project?
European and global data space initiatives and projects - BDVA, IDSA, Gaia-X.
Organizations representing the above listed benefactor categories.
Plan for growing in maturity if accepted within LF Energy

Refactoring the code base towards production ready state.
Validation of the solutions and established best practices with new integrators.
Confirming replicability at a global level (EU based until now).
Alignment with additional standards (protocols, data models and ontologies).
Validation and strengthening of open source practices.
Establishment of a roadmap supported by a community.
Improving user (service providers) experience and streamlining the onboarding and maintenance process based on feedback from the community and new integrators.

Project license
Apache 2.0 and GNU 3.0 (Service Store to be migrated to Apache 2.0).
Is the project's code available now? If so provide a link to the code location.
Yes, the key building blocks have their own repositories all under the project Gitlab.
Knowledge Engine - https://gitlab.inesctec.pt/interconnect-public/knowledge-engine
Service Store BE - https://gitlab.inesctec.pt/interconnect-public/service-store-backend
Service Store FE - https://gitlab.inesctec.pt/interconnect-public/service-store-frontend
Generic Adapter - https://gitlab.inesctec.pt/interconnect-public/generic-adapter
P2P marketplace enablers (different branches are different configurations) - https://gitlab.inesctec.pt/interconnect-public/p2p-marketplace
Does this project have ongoing public (or private) technical meetings?
Yes, private meetings.
Does this project's community venues have a code of conduct? If so, please provide a link to it?
Our ongoing activities are specified by the project’s grant agreement and consortium agreement (standard practice for the EU funded projects). Going forward we will fully align with the LF for Energy code of conduct.
Describe the project's leadership team and decision-making process.
The project is currently led by a team of four decision makers (from three organizations - see the Current Leads section) with equal voting rights. All decisions regarding new research directions, development, integration, partnering and deployment is made with voting where 3 out of 4 in favor constitutes a decision to move forward.
Does this project have public governance (more than just one organization)?
Yes, three organizations are directly involved in the project and decision making (see Current Leads section).
Does this project have a development schedule and/or release schedule?
Yes, the development roadmap and release schedule were followed in line with the InterConnect project’s work plan and grant agreement.
Going forward, the release schedule and roadmap are going to be set in accordance with new opportunities and LF for Energy requirements.
Does this project have dependencies on other open source projects? Which ones?
Yes,
Knowledge Engine.
Hyperledger Fabric for P2P marketplaces.
Details for all dependencies (libraries and open source tools) can be found within the main repositories.
Describe the project's documentation.
Wiki page for overall description of the project and key components also providing linkage to the main repositories. Technical documentation, guidelines and examples accompanying every key repository.
https://gitlab.inesctec.pt/groups/interconnect-public/-/wikis/home
Describe any trademarks associated with the project.
None
Do you have a project roadmap? If so please attach or provide a link.
Roadmap was aligned with the InterConnect work plan and Grant Agreement.
A new roadmap is in preparation for the next two years and it will be aligned with the LF for Energy community requirements.
Are this project's roadmap and meeting minutes public posted?
No
Does this project have a legal entity and/or registered trademarks?
No
Has this project been announced or promoted in any press?
Yes, as part of the InterConnect project, the InterConnect SIF was featured in news articles, public events and newsletters.
https://interconnectproject.eu/clippings/
https://www.youtube.com/watch?v=2ug6t6QIE3Q
Does this project compete with other open source projects or commercial products?
No. The InterConnect SIF is positioned as an enabling technology for building interoperable ecosystems on syntactic and semantic levels. It can complement or run in parallel with other solutions and middlewares for interoperability.

Hello, @MilenkoVizLore. Would you be available to present on April 23, from 11:00 am -12:30 pm EST?

Hi LF Energy representatives,
Yes, the proposed slot works for us.
Please also include persons from cc into the invite. We are all
representing the proposed project.
Best,
Milenko
On Wed, Apr 3, 2024 at 4:32 PM Yarille @.***> wrote:

Hello, @MilenkoVizLore https://github.com/MilenkoVizLore. Would you be
available to present on April 23, from 11:00 am -12:30 pm EST?
—
Reply to this email directly, view it on GitHub
https://github.com/lf-energy/tac/issues/132#issuecomment-2034795662, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ACCYYOEW54V6NSMFDQIEY23Y3QHJDAVCNFSM6AAAAABFONY4CKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMZUG44TKNRWGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Milenko Tosic
Director of Innovation
VizLore Labs
www.vizlore.com
@.***
+381644179669

Hi @yarille ,
Are we expecting some meeting invitation for April 23?
Please include these gentlemen in the invite:
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>Thanks.

Project approved by TAC voting members on 4/23.


Improved the UI by Color Changed and various location added

issue resolved #143

Add time section(you have seen the layout of book my show for movies in that there are given dates list of theatres and time slot available so you can do it in that way also it will look good and also helps user to chooseslot quickly)
List of hospital
List of OPD sections like ent, gynecologist,etc

Okay I'll do by tomorrow thank you so much
On Thu, 16 May, 2024, 12:07 am Anishka Gupta, @.***>
wrote:

Add time section(you have seen the layout of book my show for movies in
that there are given dates list of theatres and time slot available so you
can do it in that way also it will look good and also helps user to
chooseslot quickly)
List of hospital
List of OPD sections like ent, gynecologist,etc
—
Reply to this email directly, view it on GitHub
https://github.com/Anishkagupta04/RAPIDOC-HEALTHCARE-WEBSITE-/pull/150#issuecomment-2113203514,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A44OINNAZGOXMJJYTCMQ3DLZCOTNPAVCNFSM6AAAAABHYVWMWGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJTGIYDGNJRGQ
.
You are receiving this because you authored the thread.Message ID:
@.***
com>

#150

@Kriagr23 Thanks for your contribution 🚀


Undefined ~ macro if model is defined in a module

Just for the purpose of illustration, when I put your example into a module, this will raise "UndefVar Error: @~ not defined":
module turingmodule
using Turing

# Define a simple Normal model with unknown mean and variance.
@model gdemo(x, y) = begin
	s ~ InverseGamma(2,3)
	m ~ Normal(0,sqrt(s))
	x ~ Normal(m, sqrt(s))
	y ~ Normal(m, sqrt(s))
	return s, m
end

function main()
	#  Run sampler, collect results
	c3 = sample(gdemo(1.5, 2), SMC(1000))

	# Summarise results (currently requires the master branch from MCMCChain)
	describe(c3)
end

end

Should be fixed after https://github.com/TuringLang/Turing.jl/pull/613.


Darwin sandbox

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Fits CONTRIBUTING.md.

@domenkozar could you block this bot? See https://github.com/NixOS/nixpkgs/pull/48770

Yes, yet nonsense first time contributions. Here's another one from another "user": https://github.com/NixOS/nixpkgs/pull/49084

Interestingly those accounts are not new. Maybe someone is hackong them?


balena depends on random to be initialised before starting

Until crng has been initialised and there is enough entropy in the system, balena does not start.
This is introduced by a patch in the kernel which was backported to stable branches as well.
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=43838a23a05fbd13e47d750d3dfd77001536dd33
Reverting this patch does make balena start faster.
tl;dr Kernel used to report crng initialised when it had a small amount of entropy. Now it reports crng initialised correctly when there is good entropy.
Worst case I've seen until now is ~7 minutes
root@2410213:~# dmesg | grep -i random
...
[    1.182282] random: systemd: uninitialized urandom read (16 bytes read)
[  444.351446] random: crng init done
[  444.351453] random: 7 urandom warning(s) missed due to ratelimiting
root@2410213:~#

As a result, balena starts 7 minutes later.
Various packages have fixed this in various ways.
e.g. In util-linux, a flag was passed to getrandom to make the call nonblocking
https://github.com/karelzak/util-linux/commit/a9cf659e0508c1f56813a7d74c64f67bbc962538#diff-6341cb5466770a24a1f3bfdb80803412
Lots of Debian chatter about it. https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=897572
From a cursory look, it looks like packages which wanted random (but not necessarily entropy in the security sense e.g. uuid generation) basically called getrandom with a nonblock flag so whatever random numbers came was fine.
Security stuff like ssh key gen basically have to wait. Or install something like rng-tools to improve entropy at boot faster.

Description

Steps to reproduce the issue:

Boot resinOS v2.19 on a nuc image in a VM
Check if balena is starting immediately on boot
Check if balena starts after you see the crng init message comes when you type random stuff on the keyboard

Describe the results you received:
Balena starts after crng init.
Describe the results you expected:
Balena should start at boot
Additional information you deem important (e.g. issue happens only occasionally):
Output of balena version:
root@resin:~# balena version
Client:
 Version:	unknown-version
 API version:	1.35
 Go version:	go1.9.7
 Git commit:	unknown-commit
 Built:	unknown-buildtime
 OS/Arch:	linux/amd64
 Experimental:	false
 Orchestrator:	swarm

Server:
 Engine:
  Version:	17.12.0-dev
  API version:	1.35 (minimum version 1.12)
  Go version:	go1.9.7
  Git commit:	3e2973d26934bd22c46f07764afb1ed8b11bf6a1
  Built:	Tue Oct  2 12:18:21 2018
  OS/Arch:	linux/amd64
  Experimental:	true
root@resin:~#

Output of balena info:
root@resin:~# balena info
Containers: 4
 Running: 4
 Paused: 0
 Stopped: 0
Images: 4
Server Version: 17.12.0-dev
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 41
 Dirperm1 Supported: true
Logging Driver: journald
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host ipvlan null
 Log: journald json-file
Swarm:
 NodeID:
 Is Manager: false
 Node Address:
Runtimes: bare runc
Default Runtime: runc
Init Binary: balena-init
containerd version:
runc version: 13e66eedaddfbfeda2a73d23701000e4e63b5471
init version: 949e6fa-dirty (expected: 949e6facb7738)
Kernel Version: 4.14.48-yocto-standard
Operating System: Resin OS 2.15.1+rev2
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 989.3MiB
Name: resin
ID: 4FGZ:T47Z:U7X6:45DJ:4J7P:YFN3:QQM4:WOZ3:TTBL:UMQM:QOCU:7M6V
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: 128
 Goroutines: 101
 System Time: 2018-10-08T17:23:38.887619837Z
 EventsListeners: 1
Registry: https://index.docker.io/v1/
Labels:
Experimental: true
Insecure Registries:
 <IP_ADDRESS>:5000
 <IP_ADDRESS>/8
Live Restore Enabled: false

root@resin:~#

Additional environment details (AWS, VirtualBox, physical, etc.):

@petrosagg ping on this

I still see this probleme
root@6c35b9d:~# dmesg | grep -i random
...
[    7.668674] random: systemd: uninitialized urandom read (16 bytes read)
[  195.124100] random: crng init done
[  195.124139] random: 7 urandom warning(s) missed due to ratelimiting
root@6c35b9d:~#

Description
Steps to reproduce the issue:

Boot resinOS v2.44.0+rev1 on a Raspberry Pi Zero W
Without keyboard or mouse (Only the supply power)

Describe the results you received:
Balena starts after crng init.
Describe the results you expected:
Balena should start at boot
Additional information you deem important (e.g. issue happens only occasionally):
Output of balena version:
root@6c35b9d:~# balena version
Client:
 Version:           18.09.10-dev
 API version:       1.39
 Go version:        go1.10.8
 Git commit:        7cb464a406748016f2df0c31a9851d20456a3d31
 Built:             Thu Oct 17 14:28:36 2019
 OS/Arch:           linux/arm
 Experimental:      false

Server:
 Engine:
  Version:          18.09.10-dev
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.8
  Git commit:       7cb464a406748016f2df0c31a9851d20456a3d31
  Built:            Thu Oct 17 14:28:36 2019
  OS/Arch:          linux/arm
  Experimental:     true
root@6c35b9d:~#

Output of balena info:
root@6c35b9d:~# balena info
Containers: 2
 Running: 2
 Paused: 0
 Stopped: 0
Images: 3
Server Version: 18.09.10-dev
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 27
 Dirperm1 Supported: true
Logging Driver: journald
Cgroup Driver: systemd
Plugins:
 Volume: local
 Network: bridge host ipvlan null
 Log: journald json-file local
Swarm:
 NodeID:
 Is Manager: false
 Node Address:
Runtimes: bare runc
Default Runtime: runc
Init Binary: balena-engine-init
containerd version:
runc version: b3d5036b6520060db00c81352d533a5dd919aaaf
init version: 949e6fa-dirty (expected: fec3683b971d9)
Kernel Version: 4.19.71
Operating System: balenaOS 2.44.0+rev1
OSType: linux
Architecture: armv6l
CPUs: 1
Total Memory: 479.4MiB
Name: 6c35b9d
ID: 6W6G:AE3G:N44J:PACE:NJ7S:U5U2:YMSE:ZZLT:HRSI:2QZO:PGNM:LXRN
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: true
Insecure Registries:
 <IP_ADDRESS>/8
Live Restore Enabled: false

WARNING: No cpuset support
root@6c35b9d:~#

@chpeps how long is the delay you experience? Can you post the output of sytemd-analyze blame

about ~6 minutes after power on.
Output of systemd-analyze time:
root@6c35b9d:~# systemd-analyze time
Startup finished in 6.414s (kernel) + 4min 54.135s (userspace) = 5min 550ms
multi-user.target reached after 4min 53.863s in userspace

Output of systemd-analyze blame:
root@6c35b9d:~# systemd-analyze blame
     1min 2.909s resin-supervisor.service
         55.448s balena.service
         18.100s os-networkmanager.service
         12.812s os-udevrules.service
         12.798s os-sshkeys.service
         12.318s balena-device-uuid.service
         11.502s dev-disk-by\x2dpartuuid-ef943c7a\x2d02.device
         11.330s mnt-sysroot-active.service
          9.551s resin-net-config.service
          9.517s dev-disk-by\x2dlabel-resin\x2dstate.device
          9.315s systemd-udev-settle.service
          8.738s resin-persistent-logs.service
          7.638s dev-mmcblk0p1.device
          5.654s dev-mmcblk0p6.device
          4.576s resin-proxy-config.service
          3.687s resin-hostname.service
          3.428s prepare-openvpn.service
          3.198s ModemManager.service
          2.452s resin-filesystem-expand.service
          2.215s systemd-udev-trigger.service
          1.920s systemd-logind.service
          1.701s timeinit-timestamp.service
          1.158s resin-state.service
           805ms bind-etc-hostname.service
           786ms var-volatile-srv.service
           762ms systemd-journald.service
           757ms bind-etc-NetworkManager-system-connections.service
           740ms systemd-update-utmp.service
           729ms var-volatile-spool.service
           726ms bind-var-lib-bluetooth.service
           657ms bind-etc-docker.service
           646ms var-volatile-cache.service
           616ms bind-var-lib-NetworkManager.service
           605ms sys-kernel-config.mount
           584ms bind-home-root-.ssh.service
           554ms resin-init.service
           534ms NetworkManager.service
           489ms os-config-devicekey.service
           458ms tmp.mount
           389ms systemd-tmpfiles-clean.service
           373ms systemd-tmpfiles-setup-dev.service
           315ms resin-data.service
           301ms plymouth-start.service
           290ms wpa_supplicant.service
           281ms systemd-udevd.service
           220ms dnsmasq.service
           192ms systemd-update-utmp-runlevel.service
           177ms balena-host.socket
           143ms sshd.socket
           134ms systemd-tmpfiles-setup.service
           132ms var-volatile.mount
           129ms var-lib-docker.mount
           129ms sshd@1-<IP_ADDRESS>:22222-<IP_ADDRESS>:43724.service
           126ms avahi-daemon.service
           115ms resin\x2ddata.mount
            96ms systemd-random-seed.service
            93ms plymouth-read-write.service
            85ms systemd-rfkill.service
            43ms balena-engine.socket


No Support for I2C Motor Controller

The Grove I2C Dual H-Bridge motor controller doesn't work with the GUI to move the robot's head.

This is the wiki: http://www.seeedstudio.com/wiki/index.php?title=Grove_-_I2C_Motor_Driver
I'm currently using the version 1.1

Note: I had this controller working before Arduino 1.0 so I'm wondering if it was the change to the wire library that made a difference.
===
Notes
Arduino Nano: I2C: 4 (SDA) and 5 (SCL). Support I2C (TWI) communication using the Wire library (documentation on the Wiring website). Arduino Leonardo: Has its own designated SDA and SCL pins.

Closing this issue because this controller is no longer used on the robot.


list_orientation_runs() raises exception when primary is missing

The hkl.util.list_orientation_runs(cat) function raises an exception when one of the runs does not have a primary stream:
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
File ~/.conda/envs/bluesky_2023_3/lib/python3.11/site-packages/intake/catalog/base.py:350, in Catalog.__getattr__(self, item)
    349 try:
--> 350     return self[item]  # triggers reload_on_change
    351 except KeyError as e:

File ~/.conda/envs/bluesky_2023_3/lib/python3.11/site-packages/intake/catalog/base.py:423, in Catalog.__getitem__(self, key)
    422     return out()
--> 423 raise KeyError(key)

KeyError: 'primary'

The above exception was the direct cause of the following exception:

AttributeError                            Traceback (most recent call last)
Cell In[24], line 1
----> 1 hkl.util.list_orientation_runs(cat)

File ~/.conda/envs/bluesky_2023_3/lib/python3.11/site-packages/hkl/util.py:264, in list_orientation_runs(catalog, limit, *args)
    262 display_columns = default_columns + list(args)
    263 for run in catalog.v2.values():
--> 264     info = run_orientation_info(run)
    265     if len(info):
    266         scan_id = run.metadata["start"]["scan_id"]

File ~/.conda/envs/bluesky_2023_3/lib/python3.11/site-packages/hkl/util.py:300, in run_orientation_info(run)
    285 """
    286 Return a dictionary with orientation information in this run.
    287
   (...)
    297     A Bluesky run, from databroker v2, such as ``cat.v2[-1]``.
    298 """
    299 devices = {}
--> 300 run_conf = run.primary.config
    301 for device in sorted(run_conf):
    302     conf = run_conf[device].read()

File ~/.conda/envs/bluesky_2023_3/lib/python3.11/site-packages/intake/catalog/base.py:352, in Catalog.__getattr__(self, item)
    350         return self[item]  # triggers reload_on_change
    351     except KeyError as e:
--> 352         raise AttributeError(item) from e
    353 raise AttributeError(item)

AttributeError: primary

Needs a catalog with such an example.  The apstools.plans.documentation_run() could provide such an example?  Or some test code with a temporary repo.

This has already been fixed via try..except clause: https://github.com/bluesky/hklpy/blob/dd2cf5a0d32e73f04d8ec5a223faff7e6f9593a2/hkl/util.py#L305-L317


Database fixes and improvements

Fixes issue #448
Changed the init method to initWithDatabaseAtPath which will allow us to override the sharedManager method in our unit tests and point to a test database (contributed by @josh64x2 )
Improved folder cache management
…

looks good!


windows line endings \r\n are mutated to \n

I'd fix it myself, but I don't know what the best way would be.
There are also other things like adding a \n at the end of file.
What do you think about doing it git-style. Reading files skips \r, but sets a flag if it encounters an \r. Writing back adds \r before every \n. This would prevent any fancy conditionals inside the logic code.

I think it should be configurable to use either \n or \r\n or preserve the file's formatting (i.e., the procedure you suggest). I suggest this because I've worked on projects (Firefox) which mandate never using windows line endings.

rustfmt doesn't have any command line arguments yet as far as I can see in the code. So I'm not sure how you want this specified. Maybe as a cfg-option? http://doc.rust-lang.org/rustc/session/config/struct.Options.html

For now, just as a global variable, there's another issue open for adding an actual config file.

apparently libsyntax removes \r before rustfmt ever sees them...

This has been resolved, right?

there has been some work towards it, but not fully resolved. I'll check next week what the current state is

We have an option with two possibilities : Unix or Windows. There is not auto-detection feature now.

Hi ! Does the referenced merge solve this issue ?

There's still no auto-detection feature, but I think the current array of options are good enough to close this issue.


[zh] resyn ref-k8s-api-config: volume.md

The source path is: content/en/docs/reference/kubernetes-api/config-and-storage-resources/volume.md
The preview link is:  https://deploy-preview-34417--kubernetes-io-main-staging.netlify.app/zh-cn/docs/reference/kubernetes-api/config-and-storage-resources/volume/

This is the final submission of #34158. Thanks all reviewers that help me grow. Thank you all.

/approve

/lgtm