feat: compute GCP resources parallelly

Description

Parallelized GCP resource computation using the ProcessPoolExecutor().
Improves tool runtime from ~160s to ~100s.
Moved functions to utils.py file

TODOs

[ ] identify the crawlers which take the most amount of time.
[ ] identify any room for improvement in performance.
[ ] refactor the code and maintain standards
[ ] add appropriate documentation for above changes

@mshudrak @ZetaTwo

I've drawn a draft plan for how the completed refactoring for scanner loop would look like. This allows us to use python's context managers for handling files. It also allows us to separate them into individual blocks of code.
What are your opinions on this @mshudrak @ZetaTwo ?
class GCPScanner:
  """
  TODO: description for GCP Scanner Class
  """

  def __init__(self) -> None:
    pass

  def crawl_loop(self):
    pass

  def is_set(self):
    pass

  def save_results(self):
    pass

  def iam_client_for_credentials(self, credentials):
    pass

  def compute_client_for_credentials(self, credentials):
    pass

  def gke_client_for_credentials(self, credentials):
    pass

  # could be separated as a separate class
  # Since, it is a complete set of different Operations
  def get_sas_for_impersonation(self, iam_policy):
    pass

  # separate this from main loop
  # Since, this need to be called prior to crawling
  def get_project_list(self):
    pass

  # context managers
  def __enter__(self):
    pass

  def __exit__(self):
    pass

Comment on -p flag. PTAL.

Working on it.

@peb-peb are you sure this step is absolutely necessary right now? Do you think it need to be implemented before we go for parallelization?

Nope. This refactorization could be done once we are done with the parallelization.
So, should we first complete the parallelization, then proceed with this?

Yes, I think it makes sense to work on parallelization first
On Sun, Jul 16, 2023, 3:56 PM Harsh @.***> wrote:

Nope. This refactorization could be done once we are done with the
parallelization.
So, should we first complete the parallelization, then proceed with this?
—
Reply to this email directly, view it on GitHub
https://github.com/google/gcp_scanner/pull/245#issuecomment-1637209521,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABUFDYXJNZSQHZR77H2GWQDXQRWQLANCNFSM6AAAAAA2K47OB4
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

@mshudrak Added the suggested changes. PTAL.
usage: python3 scanner.py -o <output_directory> -k <sa_keys_directory> -l INFO --cpu-count <any number>
Example: ``python3 scanner.py -o <output_directory> -k <sa_keys_directory> -l INFO --cpu-count 4`

Also, while deciding upon the flag for CLI, the -p flag is already used for --project, so that couldn't be used. So, instead of --parallel, I decided to go with --cpu-count or -cc.
Any other suggestions are also welcome! :)
@sudiptob2 @mshudrak @ZetaTwo

Closing as this PR would continue it's discussion in #265.


Postgres-related error upon starting container, on Windows with WSL

Summary:
Docker image built successfully. But when I try to run, I get postgres-related errors. Ideas??
Command:  /mnt/c/git/aws-mwaa-local-runner$ ./mwaa-local-env start
Result (snippet):
postgres-1      | initdb: error: could not change permissions of directory "/var/lib/postgresql/data": Operation not permitted
postgres-1      | fixing permissions on existing directory /var/lib/postgresql/data ...
postgres-1 exited with code 1
local-runner-1  | Wed Aug 21 21:58:20 UTC 2024 - waiting for Postgres... 1/20
local-runner-1  | Wed Aug 21 21:58:31 UTC 2024 - waiting for Postgres... 2/20
local-runner-1  | Wed Aug 21 21:58:43 UTC 2024 - waiting for Postgres... 3/20
local-runner-1  | Wed Aug 21 21:58:56 UTC 2024 - waiting for Postgres... 4/20
local-runner-1  | Wed Aug 21 21:59:07 UTC 2024 - waiting for Postgres... 5/20
local-runner-1  | Wed Aug 21 21:59:20 UTC 2024 - waiting for Postgres... 6/20
local-runner-1  | Wed Aug 21 21:59:32 UTC 2024 - waiting for Postgres... 7/20
local-runner-1  | Wed Aug 21 21:59:44 UTC 2024 - waiting for Postgres... 8/20
local-runner-1  | Wed Aug 21 21:59:55 UTC 2024 - waiting for Postgres... 9/20
local-runner-1  | Wed Aug 21 22:00:06 UTC 2024 - waiting for Postgres... 10/20
local-runner-1  | Wed Aug 21 22:00:19 UTC 2024 - waiting for Postgres... 11/20
local-runner-1  | Wed Aug 21 22:00:31 UTC 2024 - waiting for Postgres... 12/20
local-runner-1  | Wed Aug 21 22:00:43 UTC 2024 - waiting for Postgres... 13/20
local-runner-1  | Wed Aug 21 22:00:54 UTC 2024 - waiting for Postgres... 14/20
local-runner-1  | Wed Aug 21 22:01:07 UTC 2024 - waiting for Postgres... 15/20
local-runner-1  | Wed Aug 21 22:01:16 UTC 2024 - waiting for Postgres... 16/20
local-runner-1  | Wed Aug 21 22:01:24 UTC 2024 - waiting for Postgres... 17/20
local-runner-1  | Wed Aug 21 22:01:36 UTC 2024 - waiting for Postgres... 18/20
local-runner-1  | Wed Aug 21 22:01:47 UTC 2024 - waiting for Postgres... 19/20
local-runner-1  | Wed Aug 21 22:01:59 UTC 2024 - postgres:5432 still not reachable, giving up
local-runner-1 exited with code 0

Resolved this issue using the proposed solution, here:
https://github.com/aws/aws-mwaa-local-runner/issues/45


[Feature Request] Add Director info

Is your feature request related to a problem?
A clear and concise description of what the problem is.
Describe the solution you'd like:
A clear and concise description of what you want to happen.
Describe alternatives you've considered:
A clear description of any alternative solutions you've considered.

I'll see if the implementation is possible because the official yts.mx/api doesn't return any directory info so I might've to do it unofficially without breaking existing code.


java-openliberty:  Provide EE APIs to default template?

Today our default template provides the 3.2 aggregate MicroProfile API.
Should we consider providing EE aggregate APIs as well?  (Probably Jakarta EE 8).
Do we want to think ahead on how this default template would evolve with new MicroProfile+Jakarta spec levels (possibly by using new additional templates) before taking a first step here?

It happens that this ( providing  Jakarta EE 8 aggregate APIs) would likely fix https://github.com/appsody/stacks/issues/611.
This (639) is a bigger issue than the narrow 611 issue..that shouldn't be forcing our hand here, just noting though.


Launcher application

Create an app that launches the backend and then immediately opens the config site (currently set to http://localhost:5000). App should have the OSVR icon.

Implemented this in https://github.com/OSVR/OSVR-Config/commit/438901091ef23a80a7366c431e69e7cd74507c78
Using a launcher script for now.


AttributeError: 'Request' object has no attribute 'log'

If there is a problem with parsing the posted JSON to DRF API endpoint, drf-tracking raises this exception and causes Internal Server Error. Reason is that inside LoggingMixin.initial if there is a ParseError thrown on data_dict = request.data.dict() self.request.log is never set, but finalize_response gets called anyway.
Problem is, you never get to see the actual problem (i.e. {"detail":"JSON parse error - Expecting property name enclosed in double quotes: line 7 column 1 (char 111)"}), as the 500 Internal Error masks the problem.

Hi, how is the state of this bug, I have problem with this. Thanks

Hello, I have stumbled upon the same thing on my test suite. I'm testing accessing the given resource without authentication.
class DriverReadFailureTests(APITestCase):
    def setUp(self):
        self.client = APIClient()
        self.user = User.objects.create_superuser('admin'<EMAIL_ADDRESS>'admin123')
        self.client.force_login(user=self.user)
        self.token = Token.objects.create(user=self.user)
        self.client.post('/api/drivers/', data=driver_data, format='json')
        self.client.post('/api/drivers/', data=driver_data_second, format='json')
        self.client.logout()

    def test_read_no_auth_driver(self):
        """Try to retrieve json representation of previously added driver.
        """
        response = self.client.get('/api/drivers/')
        self.assertEqual(response.status_code, 401)

Traceback:
Error
Traceback (most recent call last):
  File "/home/bkovacev/sally-projects/ops4/drivers/tests.py", line 316, in test_read_no_auth_driver
    response = self.client.get('/api/drivers/')
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/test.py", line 282, in get
    response = super(APIClient, self).get(path, data=data, **extra)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/test.py", line 208, in get
    return self.generic('GET', path, **r)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/test/client.py", line 409, in generic
    return self.request(**r)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/test.py", line 279, in request
    return super(APIClient, self).request(**kwargs)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/test.py", line 231, in request
    request = super(APIRequestFactory, self).request(**kwargs)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/test/client.py", line 494, in request
    six.reraise(*exc_info)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/core/handlers/exception.py", line 42, in inner
    response = get_response(request)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response
    response = self.process_exception_by_middleware(e, request)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/views/decorators/csrf.py", line 58, in wrapped_view
    return view_func(*args, **kwargs)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view
    return self.dispatch(request, *args, **kwargs)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/views.py", line 483, in dispatch
    response = self.handle_exception(exc)
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework_tracking/mixins.py", line 80, in handle_exception
    self.request.log.errors = traceback.format_exc()
  File "/home/bkovacev/envs/ops4-env/local/lib/python2.7/site-packages/rest_framework/request.py", line 384, in __getattribute__
    six.reraise(info[0], info[1], info[2].tb_next)
  File "<string>", line 2, in reraise
AttributeError: 'Request' object has no attribute 'log'

How do I approach this? @avelis @aschn


[CaptionMod] Mute is not working with new chatdialog

Fixed in https://github.com/hzqst/MetaHookSv/releases/tag/v20240610a


beta version: module resolves to src/modules with baseUrl for TS

Summary
This may be related to #85, but I'm not sure it is, so creating a separate issue. I've set "baseUrl": "./src" so that I can import { foo } from 'services/toastService';.
Module not found: Could not resolve services/toastService as <full path>\GitHub\testing\src\modules\services\toastService\toastServiceundefined

Notice the undefined at the end of the error message also.

Steps To Reproduce:

Create a file like src/foo.ts
Set baseUrl in your tsconfig.json under compilerOptions object.
Try to import foo inside of a component.

Expected result
It should resolve the ts file in src/services/toastService.ts
Actual result
It is inserting a modules folder after src and failing to resolve. src/modules/services/toastService.ts
Additional information
👍 Most other stuff is working.

It's related to #85.
Assignment of something works for me.
import { LightningElement, track } from 'lwc';
import { something } from '../../../../services/toastService';

export default class App extends LightningElement {
    @track myStuff = something;
}

Fixed in latest beta. For testing you can just upgrade lwc-services to 1.3.0-beta.13.

Almost fixed. I can reference from the root with "baseUrl": "./src" set if I'm outside of the modules folder. So things like import foo from models/foo' works inside of services/toastService`.
But if I try to access anything from inside of a component file like models/foo it's resolving wrong since it's trying to resolve like src/modules/models/foo

https://github.com/dividab/tsconfig-paths-webpack-plugin
I think this plugin solves things by letting webpack read the TS config if it finds one.


[BEAM-4276] Add combiner lifting support to Go SDK

Implements combiner lifting support to the Go SDK, for universal runners.
Per https://s.apache.org/beam-runner-api-combine-model, the Go SDK puts the URN and CombinePayload on the composite containing the basic unlifted combine implementation for runners which don't support the optimization.
There are a few TODOs but I can lift them into JIRAs as necessary. Of note is that the current go implementation for Top uses an unencodable accumulator type (it contains []interface{}) so it is unable to be lifted at present. However, when this case is detected, the SDK will simply not add the URN and payload and continue with it's existing representation as a vanilla ParDo to runners.

R: @herohde @wcn3

FYI: It has been verified that this implementation still works with the unchanged Go Direct runner and with the Dataflow runner. Dataflow however doesn't yet support lifting for portable pipelines.

R: @herohde  @wcn3  Ping :)

PTAL @wcn3
Comments addressed and ready for another pass! Thanks!

R: @jasonkuster This is a meaty Go CL, so please add any oversight as you see fit, and otherwise, merge at your discretion. Thank you!

I rebased to head but otherwise the PR is unchanged.

R: @lukecwik since Jason is out today. Please merge! Thanks!

LGTM


Support for ZWO ASI462MC

Hello,
I have purchased an ASI462MC and hope to use it as a sky camera. Unfortunately, allsky does not seem to recognize it. Starting allsky manually, I get the following error:
Listing Attached Cameras:

0 ����
Open Camera ERROR, Check that you have root permissions!

���� Information:

Resolution:0x0
Pixel Size: 0.0μm
Supported Bin:
Mono camera
SDK version 1, 15, 0430
Initialise Camera ERROR
Sensor temperature:0.000000

It does look like ZWO has updated the Linux SDK to support this camera. From: https://astronomy-imaging-camera.com/software/change_log/change_ASISDK_Unix.txt
V 1.15.0617 2020.6.17
Fix some bugs
Add new camera ASI462MC
What is the process for updating the SDK? I tried manually moving the updated ZWO static library files (lib/armv*/libASICamera2.a) and header file (include/ASICamera2.h) into allsky and reinstalling but this doesn't seem to result in any change. I tried updating the api.rules but the previous ones seem adequate and this did not make a difference. I feel like I am missing something related to linking but am near the limit of my Linux software abilities. After updating the SDK, the information message from all sky still says "SDK version 1, 15, 0430". Thus I think I am doing something incorrectly.

Of course after submitting this issue, I solved the problem myself. It appears that the make all command verifies that the software is up to date by looking at the compiled output. Removing the target executables, caused the installer to rebuild them with the new ZWO SDK.
I can happily report that the ZWO ASI462MC does work with all sky once the SDK has been updated.


Escaping double quotes while using azure search sdk.md

Escaping double quotes is not necessary when using azure search SDK cause SDK escapes it on serialization

@BevLoh
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Hello @84961, I like your contribution, but you've got some formatting, punctuation, and style issues.  Can you replace your sentence with something like this, making sure that there is a space between the period and the start of the sentence:  "If you're using the Azure SDKs, the search client escapes the quotation marks when it serializes the search text.  Your search phrase can be sent be as "Roach Motel".

@HeidiSteen I have updated the styling and spacing and wordings as suggested.

taking @HeidiSteen 's comment as approval.


[EmitC] Adapt lit tests to emitc.funcs default dialect

Changes needed to integrate https://github.com/llvm/llvm-project/pull/116297
Generated by:
for op in call_opaque apply assign load literal subscript call cast add logical_not cmp logical_or logical_and; do sed -i "s/emitc.$op/$op/g" compiler/src/iree/compiler/Dialect/VM/Conversion/VMToEmitC/test/*.mlir; done

Thanks! I merged this into https://github.com/iree-org/iree/pull/19245


Updated New-AZDOPSVariableGroup

Co-authored-by: John Roos<EMAIL_ADDRESS>❤ 🦆
Overview/Summary
Updated the way we handle and structure the hashtable input for New-AZDOPSVariableGroup.
As part of this Pull Request I have

[x] Checked for duplicate Pull Requests
[x] Associated it with relevant issues, for tracking and closure.
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[x] Performed testing and provided evidence.
[x] Updated relevant and associated documentation.

Missing updated help documentation for the new way of adding hashtables. Nicely solved!


CORS not working

Hello,
I'm trying to use CORS in my project, but I think that the server is responding an OPTIONS event with a POST response.
Code:
settings: {
port: process.env.PORT || 3000,
ip: '<IP_ADDRESS>',
bodyParsers: {
  json: true
},

cors: {
  origin: '*',
  methods: ['GET', 'OPTIONS', 'POST', 'PUT', 'DELETE'],
  allowedHeaders: [],
  exposedHeaders: [],
  credentials: false,
  maxAge: 3600
},

routes: [
  {
    path: '/api',

    aliases: {
      'POST /user/login': 'user.login'
    },

    cors: {
      origin: ['http://localhost:4200'],
      methods: ['GET', 'OPTIONS', 'POST'],
      credentials: true
    },

    mappingPolicy: 'restrict',

    authorization: true
  }
]

},
Have any idea?

Problem solved!
I just update the version of moleculer-web to 0.5.2, insert OPTIONS route and everything is working good.


Document scaleable-file-processing config

Add READ.me

Also fix issue with loop ending when no slaves available


[QUESTION] Multiple Header cells with same name - problem in import - possible to use cell number ?

Screenshot of Excel file

I'm importing an Excel file which comes from an external system, which can not be changed by me nor my customer.
I found out that in the Excel file two header cells have the same name "Nummer" :-(
When importing and showing the value of the imported line, I can clearly see that ONLY the second cell with "Nummer" is taken into the values.

So first question is : why is only the cell H1 from the header is imported and NOT cell A1 ?
Second : I would think I could use a call like :

But I think this is not possible because I have the setting on "sluggish"?
Who can help please?
Best regards,
Davy

As I did not get an answer, I tried to dive into the issue myself.
I suppose the issue might lie in the function "Laravel-Excel / src / Maatwebsite / Excel / Parsers / ExcelParser.php" ?
protected function getIndices()
{
// Fetch the first row
$this->row = $this->worksheet->getRowIterator($this->defaultStartRow)->current();

// Set empty labels array
$this->indices = [];

// Loop through the cells
foreach ($this->row->getCellIterator() as $this->cell) {
**$this->indices[] = $this->getIndex($this->cell);**
}

// Return the labels
return $this->indices;
}

Solution given in #1524


[Bug]: Redis: Test doesn't pass when the user edits an existing Redis datasource in a particular case

Is there an existing issue for this?

[X] I have searched the existing issues

Description
Redis: Test fails when the user edits an existing Redis datasource in a particular case where the user enters some value and saves and then removes the values and saves again and test.
Steps To Reproduce

Create a Redis datasource (in my case, created one through a docker image)
[Note : Only the host address and the port number s required]
Edit the same
Pass username / password [which is not required in this case]
Save it again
Edit the same again and remove the username and password
Test it again
Observe - It fails

Public Sample App
No response
Environment
Production
Issue video log
https://knynrq7fk9.vmaker.com/record/PktZN8b1nnYRnwx1
Version
1.9.9

@AnandShahs123 would you please re-attach the video? The link is broken


prometheus container_network_transmit_bytes_total != aws monitoring "network out (bytes)"

What did you do?
I'm trying to get a basic result of how many bytes were sent from a single machine (AWS EC2)
I have an eks with a single ec2 node, with prometheus installed via helm (official release chart..)
I ran the below promQL
sum(rate(container_network_transmit_bytes_total[1h]))
and tried to see if I get the same result in aws ec2 monitoring metrics
network out (bytes)   sum of every 1 second  in 1 hour interval
I see completely different numbers
What did you expect to see?
I expected to see the same numbers
What did you see instead? Under which circumstances?
I have 1 single VM in my aws region
I am trying to validate prometheus metrics with AWS monitoring metrics
prometheus is giving me x2 of what ec2 monitoring metrics are showing
For example:
AWS ec2 monitoring says, sum of 1 second in a 1 hour interval == 1mb sent
prometheus sum of 1 second in a 1 hour interval == 2mb sent
given by this query sum(rate(container_network_transmit_bytes_total[1h]))
I also tried to subtract and combine the result of sum(rate(node_network_transmit_bytes_total[1h]))
What am I doing wrong?
Is this a bug?
this also applies for Average , completely different numbers
Need help guys
System information
Amazon linux 2  t3.xlarge
Prometheus version
15.10.5

Prometheus configuration file
the official prometheus helm chart
deployed in my eks cluster

Alertmanager version
not relevant

Alertmanager configuration file
not relevant

Logs
not relevant

I'm seeing the same thing, only 10x the pods on a machine means 30x the sum of network traffic.  I think the problem isn't in Prometheus but something odd/misunderstood in cadvisor.
sum by (instance, pod) (rate(container_network_transmit_bytes_total{instance=~"ip-10-179-73-87.ec2.internal", pod=""}[5m])) shows a graph between 19MB/s and 25MB/s
sum by(kubernetes_node) (rate(node_network_transmit_bytes_total{kubernetes_node=~"ip-10-179-73-87.ec2.internal"}[5m]))  shows a graph between 19MB/s and 25MB/s, with an acceptable margin-of-error difference -- I'd accept they're the same.
Notice the first query I asked for pod="" so cadvisor metrics assocated with NO pod and thus NO container!  When I ask for the per-pod metrics, I'd expect to see something that would sum-up to node_network_transmit_bytes but instead
sum by (instance, pod) (rate(container_network_transmit_bytes_total{instance=~"ip-10-179-73-87.ec2.internal", pod!=""}[5m])) shows me almost every (but not every) pod on the machine is using between 1MB/s and 25MB/s .  If I were to sum by (instance) that number would be 30x what the node_network_transmit_bytes reports is sent out by that instance.
I don't know the answer but after two hours this is the first mention I've seen of the trouble I'm having, so I'm leaving a comment.


docs: document how to add/update casks

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.
[ ] Have you successfully run brew style with your changes locally?
[ ] Have you successfully run brew typecheck with your changes locally?
[ ] Have you successfully run brew tests with your changes locally?

Replaces https://github.com/Homebrew/homebrew-cask/blob/master/doc/development/adding_a_cask.md and finishes migrating cask docs to the general Homebrew docs.
CC @Homebrew/cask

Review period will end on 2021-12-23 at 18:49:55 UTC.

Review period ended.


Support graphql-java schema lint

Is your feature request related to a problem? Please describe.
I hava a graphql-js implementation calling graphql-java, while I was trying to deprecate some field in a fragment, I ran into the validation error, I wonder if there is a way to catch that with this tool.
https://www.graphql-java.com/documentation/sdl-directives#declaring-directives
Describe the solution you'd like
Support linting for deprecated directive locations
Describe alternatives you've considered
n/a
Additional context
Error message
Validation error (MisplacedDirective@[xx/xx]) : Directive \'deprecated\' not allowed here\n\nPath: xx/xx/xx."

I can see this is a problem btw the different graphql implementations.

relates to https://github.com/graphql-java/graphql-java/issues/3694

please provide example of code which you want to lint, closing for now due time, feel free to reply and I'll reopen


Adds sparse communicator class

Based on #1544
This PR adds a class that handles the communication of a local vector. It uses the neigborhood non-blocking all-to-all for this. The sparse comm is constructed from an index_map.
In another PR this will be used in the distributed matrix.
Note: This uses C++17 to use type-erasure for the sparse_communicator.
PR Stack:

[ ] #1545
[ ] #1543
[ ] #1579
[ ] #1544
[ ] #1548
[ ] #1546
[ ] #1549

@upsj I think this PR might be a good opportunity to discuss your distributed::RowGather idea. In principle this class is already that, but not in the lin-op hierarchy.

This is superseded by #1588 and #1589


Error /opt/app-root/src/.node-red/package.json not found

When installing additional packages from the Node-RED Manage Palette into a Node-RED Starter container running on IBM Cloud Code Engine, there is an error message:
msg : error
"Error: ENOENT: no such file or directory, open '/opt/app-root/src/.node-red/package.json'"

The packages get installed successfully, but the error message confuses users.
@hammoaj  suggests a tweak to avoid this errors when installing new nodes from the Manage Palette. It looks as if later versions of Node-RED expect a package.json file to be present in the data directory to update when you install a new node, and it errors if it isn’t there.
A minimal package.json file is needed as it will lose the content between redeploys (unless the data directory is mapped to a persistent volume which it typically won’t be on Code Engine).
The build pipeline should copy in a simple package.json to /opt/app-root/src/.node-red/package.json

I'm okay with adding the file, but can you test to make sure it works first @hammoaj?

Not quite:
docker login -u iamapikey -p <apikey> us.icr.io
docker  pull us.icr.io/devnation-walicki/walickinoderedtest@sha256:fff
docker run -d -p 1880:1880 us.icr.io/devnation-walicki/walickinoderedtest@sha256:fff
docker cp temp.json us.icr.io/devnation-walicki/walickinoderedtest:/opt/app-root/src/.node-red/package.json
docker stop abc123
docker commit abc123 us.icr.io/devnation-walicki/walickinoderedtest:latest
docker push us.icr.io/devnation-walicki/walickinoderedtest:latest

Then in Code Engine - > Edit and Create New Revision
Node-RED starts.  Spews this error:
3/24/2022, 10:59:17 PM
msg : string[552]
"npm ERR! code EJSONPARSE↵npm ERR! file /opt/app-root/src/.node-red/package.json↵npm ERR! JSON.parse Failed to parse json↵npm ERR! JSON.parse Unexpected token } in JSON at position 140 while parsing near '...e",↵npm ERR! JSON.parse   "author": "",↵npm ERR! JSON.parse }↵npm ERR! JSON.parse '↵npm ERR! JSON.parse Failed to parse package.json data.↵npm ERR! JSON.parse package.json must be actual JSON, not just JavaScript.↵↵npm ERR! A complete log of this run can be found in:↵npm ERR!     /opt/app-root/src/.npm/_logs/2022-03-25T02_59_15_500Z-debug.log↵"

Because Adam's example has a misplaced , after "author": "",

Once I fixed the json syntax in the temp.json, repeated the steps above, started a new Code Engine revision, it worked perfectly.  I was able to add additional packages via the Manage Palette.  No errors in the debug sidebar.

We could also bump the Dockerfile from  nodejs-14-minimal to nodejs-16-minimal but I'll open a separate PR for that.

I think there is another way to fix this.  /opt/app-root/src/package.json already exists.  It contains a variety of Node-RED nodes.  There's a node_modules directory.  This is the "root" of where Node-RED is running.  There's nothing in /opt/app-root/src/.node-red/  Adding a dummy package.json maybe just confuses things.  At best, it separates user added nodes from the core nodes (but that has drawbacks too)
The bluemix-settings.js has logic to define the user.dir location.
var userDir = path.join(__dirname,".node-red");
// Ensure userDir exists - something that is normally taken care of by
// localfilesystem storage when running locally
if(!fs.existsSync(userDir)) fs.mkdirSync(userDir);
if(!fs.existsSync(path.join(userDir,"node_modules"))) fs.mkdirSync(path.join(userDir,"node_modules"));

We could just change the bluemix-settings.js so that
var userDir = __dirname;
I'm experimenting with a commit which
Update bluemix-settings.js userDir to point to /opt/app-root/src instead of /opt/app-root/src/.node-red

I don't know if a change of userDir would have implications for Node-RED Starter app Cloud Foundry deployments.  Not certain how to test that within the CF pipeline process.

Related to #166


Add support for soy aka closure-templates

https://github.com/google/closure-templates
for instance when used with Micronaut:
https://micronaut-projects.github.io/micronaut-views/latest/guide/#soy

Thanks for the request, we will look into supporting this.

Hey sorry for the delay on this. We've been spending time investigating how to test and validate the GCP libraries recently and have not been expanding the scope of our supported libraries.
Unfortunately we decided that we are not planning on supporting this library because it is outside the scope of Google Cloud; our project currently is just targeting client libraries for GCP services (like Pub/Sub, Spanner, Storage, etc.). Not quite ready to extend to all google projects.
Apologies as this should be been communicated earlier. Will close this for now. If you need some assistance on figuring out the reflection configuration for this library I will be happy to give some pointers.


feat: add sushi.com

:clipboard: Add associated issues, tickets, docs URL here.
Overview
Add Sushi to the list of projects on Boba network.
Changes
Describe your changes and implementation choices. More details make PRs easier to review.

Add sushi logo
Add sushi to json list

Testing
Describe how to test your new feature/bug fix and if possible, a step by step guide on how to demo this.

Codecov Report
Base: 46.03% // Head: 79.30% // Increases project coverage by +33.27% :tada:

Coverage data is based on head (fcd3db2) compared to base (33f6a50).
Patch has no changes to coverable lines.

Additional details and impacted files
@@             Coverage Diff              @@
##           develop     #435       +/-   ##
============================================
+ Coverage    46.03%   79.30%   +33.27%
============================================
  Files          102       38       -64
  Lines         3971     1300     -2671
  Branches       792      201      -591
============================================
- Hits          1828     1031      -797
+ Misses        2143      269     -1874

Flag
Coverage Δ

boba-contracts
?

contracts
79.30% <ø> (ø)

core-utils
?

data-transport-layer
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...ore-utils/src/external/ethers/fallback-provider.ts

...cts/contracts/libraries/CrossDomainEnabledFast.sol

...contracts/contracts/L1CrossDomainMessengerFast.sol

packages/boba/contracts/contracts/AtomicSwap.sol

packages/core-utils/src/external/bcfg/index.ts

...racts/contracts/oracle/SimplePriceFeedRegistry.sol

...boba/contracts/contracts/libraries/SafeMathDAO.sol

.../contracts/contracts/lzTokenBridge/lzApp/LzLib.sol

packages/core-utils/src/external/geth/index.ts

.../contracts/contracts/L1MultiMessageRelayerFast.sol

... and 54 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


chore: bdd-spring-1582598284 to 0.0.1

chore: Promote bdd-spring-1582598284 to version 0.0.1

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


An option to disable underlining?

I find those underlines distracting, and would like to disable the same.
let g:everforest_disable_underline = 1

I can't reproduce, please follow the issue template to provide detailed information.

@theteachr - Perhaps this is the same as issue #46?

@sunaku, thanks! I can do with the  workaround mentioned in #46.


Bumped swagger UI version

Coverage remained the same at 100.0% when pulling 590a46ccae601cd5e364221372766f58c321b3f2 on swaggered-ui into a97bf4b1ac837593fb2783758e722d500731647d on master.

Coverage remained the same at 100.0% when pulling 590a46ccae601cd5e364221372766f58c321b3f2 on swaggered-ui into a97bf4b1ac837593fb2783758e722d500731647d on master.


Allow nested destructure/patterns in for loop variables

Use Case
This works:
for (i, x) in items.enumerate()

but this doesn't
for (i, (label, content)) in items.enumerate()

Works now.


ProxyCache

Hi，I have a need to achieve cache in file like ngx_http_proxy_module proxy_cache_path。
Can i configure it？ if not, What should i do，it be better.
Because I originally used the nginx proxy cache, I want to try not to change the original storage method when I migrate.
Kong Version:
2.0.1

You can't use the same existent Nginx cache files if that's what you meant. You should take a look at the docs for the proxy-cache plugin, it supports caching the results of the requests in memory, which is essentially the same you get with ngx_http_proxy_module, but the cache has to be repopulated when restarting Kong.


restructure ML input, parameter and output

Signed-off-by: Yaliang Wu<EMAIL_ADDRESS>Description
We put ML input, output and parameter class in one package. As we add more algorithms, the package is bloating quickly. This PR split the ML input, output and parameters into different sub-packages to have a clear structure.
Read comment below to learn more details.
Input
input
├── execute  # this package contains all execute algorithm input. Execute algorithm doesn't have model, for example anomaly localization
│   ├── anomalylocalization
│   │   └── AnomalyLocalizationInput.java
│   └── samplecalculator
│       └── LocalSampleCalculatorInput.java
├── Input.java # General Input interface
├── MLInput.java # General ML algorithms can use this input class which contains algorithm name, parameter and input data set
└── parameter # This package contains ML model parameters
    ├── ad
    │   ├── AnomalyDetectionLibSVMParams.java
    │   ├── BatchRCFParams.java
    │   └── FitRCFParams.java
    ├── clustering
    │   └── KMeansParams.java
    ├── MLAlgoParams.java
    ├── regression
    │   └── LinearRegressionParams.java
    └── sample
        └── SampleAlgoParams.java

Output
output
├── execute # this package contains all execute algorithm output.
│   ├── anomalylocalization
│   │   ├── AnomalyLocalizationOutput.java
│   │   └── Counter.java
│   └── samplecalculator
│       └── LocalSampleCalculatorOutput.java
├── MLOutput.java # General ML output
├── MLOutputType.java # ML output type
├── MLPredictionOutput.java # ML prediction output
├── MLTrainingOutput.java # ML training output
├── Output.java # General output interface
└── sample # For model based algorithm, if it needs custom output, you can define a new package like this sample algo and put custom output in it
    └── SampleAlgoOutput.java

Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@jackiehanyang You may need to change the parameter class path in SQL plugin once SQL bump to 2.0


iCloud

Hi there,
i can't seem to succesfully add my iCloud drive folder, it's not finding any results. I've set the path to:
~; ~/Library/Mobile Documents/com~apple~CloudDocs
Not getting any errors either, checked the "Alfred debug log" too.
Any idea what might be happening?
Thank you!

Sorry for not getting back to you sooner. I tested the exact settings myself and can confirm that it works as expected in my environment. I was able to locate all files and folders under ~ and ~/Library/Mobile Documents/com~apple~CloudDocs, except for invisible (dot) files/folders.
The issue may be related to some iCloud configuration settings. I will update you if I find any further information.


Fix config options for Android release builds

Connection with issue(s)
Resolve issue #294
Testing and Review Notes
Using reflection was not a good idea because when the Android App is compiled for release mode, some code optimizations are executed. The fields of the configuration classes were then renamed and the mapping via reflections did not work anymore. Now everything has an explicit mapping from the untyped HashMap to the class fields and vice versa.
In order to test this, just compile a release build of the example repository and try to set some other default options. It will not work. A good example is to set useShouldOverrideUrlLoading to true and then use the callback for it.

13 days to review this very important change?
Can this be released ASAP?
It voids any release build.

looks like @pichillilorenzo is inactive since December. I hope he wakes up again and maintains this awesome Plugin. But in the meantime, I guess you will have to make your own fork and merge in the patches that you need. This is also how we currently do it for the project I am working for.

it works, thank you

Yep, thanks a lot!

oh, nice, i've opened an issue on this 2 weeks ago: https://github.com/pichillilorenzo/flutter_inappwebview/issues/315
Apparently, another workaround to fix this is to find the missing classes with logcat and add them to proguard.
Maybe we should retake this package and publish a new one on pub.dev. Anyone want to collaborate on this? it's a shame this package is not maintained anymore

@arnaudelub hm, really looks like the original maintainer abandoned this repo here. If you want to make a fork, I would be in to collaborate on it. On my current project, we are heavily using web views and I already have some other minor changes that are internal for now. It would be nice to have a more responsive open source repo where I then could open PRs for everything that I find is missing/needs fixing.

@wwwdata nice, so let's do it, but i think i'll fork it and rebuild a new plugin so we can put it on pub.dev

Released new version 3.0.0. Thanks!


SQL BOOLEAN is permitted and hence generates code that's not compileable

The following SQL code does not fail when executing generateSqlDelightInterface
CREATE TABLE hockey_player (
  injured INTEGER AS BOOLEAN DEFAULT 0
)

It'll generate BOOLEAN injured(). Either an error should be emitted or in the Java Code the appropriate type (boolean or Boolean) should be used depending on nullability.

Actually I think this one is works as intended...the IDE should red underline BOOLEAN though. If thats not happening feel free to reopen and ill investigate. All types are valid to the sqldelight compiler but will fail during the java compiler (because there is a generated BOOLEAN injured() column).

The red underlining does work.


Changed mutability & improved readability

Changed array's mutability where it was unnecessary, changed some functions to arrow functions further improving readability of said files. (account.js)

@Croustys See https://github.com/openstreetmap/iD/pull/8046#issuecomment-703656581. I'm glad you're interested in contributing, but these types of changes seem rather minor and arbitrary.


There is no read-only option

It would be nice to view a Tablero board without granting it write access to all my public git repos.

Great! I think this is a great feature! Thanks for your suggestion.

There's already an issue covering that (#55). But thanks for the feedback :smile:


Hide half-baked effects: Coroutine and CutFalse

IMHO, these effects aren't production ready. This was decided on today's session where @liskin, @xkollar, @Siprj, and I participated.

Alternative to removing an effect is to find a more practical definition. For example Coroutine could be useful, but its current definition is a proof of concept, and not a practical effect.

Also NonDet does not feel right...

We should look into extensible-effects, they seem to have figured some things out already.

I think that PR #25 made Coroutines much more useful for real applications.

@xkollar how does NonDet not feel right?

@spacekitteh: I would expect something with that name to behave more like list. Or do I miss something obvious?

It's an implementation of a non-biased nondeterminism monad. See here.


Improve project structure.

Let's establish a src directory.
Also a settings.json to hide compiled outputs in VSCode.

Also added package.json for dev dependency tracking.

Fixed by c891af4de0c7ef40a9edf14a7eb4b3226fae5daa


from utee import misc ModuleNotFoundError: No module named 'utee'

when I run " python mnist/train.py",there is an error.
from utee import misc ModuleNotFoundError: No module named 'utee'
How can I fix it?

i meet the problem, too! have you solved it


Incorrect Spelling

in the segment "including ones like keyboard and mic." I believe you intended to type "mice."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 257dc32b-f302-db2a-2571-8f217007d893
Version Independent ID: 92b2f238-f621-3feb-5b5b-07aed095b115
Content: Suggested Prototype Boards - Windows IoT
Content Source: windows-iotcore/tutorials/quickstarter/PrototypeBoards.md
Product: windows-iot
GitHub Login: @saraclay
Microsoft Alias: saclayt

Thank you! Feel free to edit the doc directly next time.


Android 12 Crash

[x] I have verified there are no duplicate active or recent bugs, questions, or requests

Include the following:

PlaylistCore version: 2.0.1
Device OS version: 12
Devide Manufacturer: Google
Device Name: Pixel 4

Reproduction Steps
Caused by java.lang.IllegalArgumentException
jp.co.hivelocity.glay.staging: Targeting S+ (version 31 and above) requires that one of FLAG_IMMUTABLE or FLAG_MUTABLE be specified when creating a PendingIntent. Strongly consider using FLAG_IMMUTABLE, only use FLAG_MUTABLE if some functionality depends on the PendingIntent being mutable, e.g. if it needs to be used with inline replies or bubbles.
android.app.PendingIntent.checkFlags (PendingIntent.java:375)
android.app.PendingIntent.getService (PendingIntent.java:686)
com.devbrackets.android.playlistcore.manager.BasePlaylistManager.createPendingIntent (BasePlaylistManager.kt:493)
com.devbrackets.android.playlistcore.manager.BasePlaylistManager.constructControlIntents (BasePlaylistManager.kt:469)
com.devbrackets.android.playlistcore.manager.BasePlaylistManager. (BasePlaylistManager.kt:143)
com.devbrackets.android.playlistcore.manager.ListPlaylistManager. (ListPlaylistManager.kt:30)
jp.co.hivelocity.glay.manager.PlaylistManager. (PlaylistManager.java:66)
jp.co.hivelocity.glay.App.onCreate (App.java:84)
Expected Result
Pending Intent to be solved
Actual Result

See #80

@brianwernick  sorry , is these changes already published to latest version ?


Bug Fix: AzureChatOpenAI streaming with function calls

Description: During streaming, the first chunk may only contain the name of an OpenAI function and not any arguments. In this case, the current code presumes there is a streaming response and tries to append to it, but gets a KeyError. This fixes that case by checking if the arguments key exists, and if not, creates a new entry instead of appending.
Issue: Related to #6462
Tag maintainer: @hwchase17, @baskaryan

Sample Code:
llm = AzureChatOpenAI(
    deployment_name=deployment_name,
    model_name=model_name,
    streaming=True
)

tools = [PythonREPLTool()]
callbacks = [StreamingStdOutCallbackHandler()]

agent = initialize_agent(
    tools=tools,
    llm=llm,
    agent=AgentType.OPENAI_FUNCTIONS,
    callbacks=callbacks
)

agent('Run some python code to test your interpreter')

Previous Result:
File ...langchain/chat_models/openai.py:344, in ChatOpenAI._generate(self, messages, stop, run_manager, **kwargs)
    342         function_call = _function_call
    343     else:
--> 344         function_call["arguments"] += _function_call["arguments"]
    345 if run_manager:
    346     run_manager.on_llm_new_token(token)

KeyError: 'arguments'

New Result:
{'input': 'Run some python code to test your interpreter',
 'output': "The Python code `print('Hello, World!')` has been executed successfully, and the output `Hello, World!` has been printed."}

thanks @jacobswe!


gotoh tuners are too close to edge

generated by regression
pylele_test_out_3.12_ubuntu-24.04(1)/pylele2.pylele_all_assembly/gotoh_tuners/trimesh/LeleAllAssembly

fixed with 084d7ac


Refactor sensitive terms in the configurations

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Update workflow to install Lua & LuaRocks via apt-get

As the current GitHub actions runner uses Ubuntu 20.04 which does not contain Lua 5.4 we need to use a custom GH Action, see #18 .
Once the runner is updated to Ubuntu 22.04 we can use the following step to install Lua:
      - name: "Install prerequisites"
        run: |
          sudo apt-get update
          sudo apt-get -y install lua${{ matrix.lua_version }} liblua${{ matrix.lua_version }} lua-any luarocks

@kaklakariada i would like to do

@RishiKumarRay thank you for your offer! I am happy to accept your pull request, but we will need to wait until the GitHub Actions runner uses Ubuntu 22.04.


Links under 'Feature Contributions' are hard to read (dark themes)

VS Code Version: 1.55.2
OS Version: checked on Linux and MacOs

Steps to Reproduce:

In the extensions panel, search for an extension (e.g. GitLens).
Go to the Feature Contributions tab.
Observe that the links do not use the user theme colors. In particular, they are hard to read with most dark themes.

Does this issue occur when all extensions are disabled?: Yes

@sandy081 Was second selector supposed to be for :hover & :active state? Right now both CSS selectors are the same.

Thanks for catching this. Fixed.


Fix up README

Just made the README more consistent, so it reads better overall.

Thanks, I'll get it merged in later.


Start Week with Monday

Hello,
how can i configure to start the picker with monday?(not sunday)

Hi, currently the only way to change this is to rewrite the logic inside buildCalendar(), but I'm not sure I can find the time to do so. If you'd like to help, you may fork the repo and add the new logic; then I'll be happy to push the changes on the repo.
Regards.


New heat capacity function and example

Revision of the heat capacity calculation function.  See calculate_heat_capacity.py for how to call.  Note that a new .nc must be located where the script ran that run, and the number of replicas and min/max temperature must correspond to what the replica exchange simulation was run with (we need a better way of passing that data to analysis scripts. I didn't not include an example .nc file to avoid cluttering the repository.

This seems to be working as expected - I tried a different example (24mer with 48 replica from 50K to 600K) with various intermediate temps, and got Cv plots similar to the one you showed yesterday.
We should get rid of or update heat_capacity.py in that same example folder to avoid confusion.

OK, I cleaned out that folder.

I realized there was no way to control the plot, so I added a plot_file argument to the main function call to get that information down to the plot function
.pdf with vector graphics is better than .png, so I switched to plotting .pdfs.
I added text printout of the energies so they can be seen.
I removed heat_capacity.py, helix.pdb and several plots for replica exchange that are no longer generated here.

These changes seem to work OK, so I was about to merge, but now this branch seems to be including the expectation value PR (#18) as well. So I'll wait until you review that one before I merge this one into master.


Translate docs/reference/kubernetes-api/cluster-resources/lease-v1

This lease is not sure how to translate.
Fixes 34441

/approve

Thanks, looks good to me! 🎉
/lgtm


EventForegroundTask did not work

How to reproduce

Start an example app, and some events added to the database.  (Listener.OnUpdate() called, but the listener is nil)
Wait a few minutes to pass the interval set on the BKTConfig, but EventInteractor.sendEvents() did not call.
The events were not sent to the server.

Expectation

EventUpdateListener should not be null when init EventInteractor
EventInteractor.sendEvents() should call when EventUpdateListener.OnUpdate() called
EventInteractor.sendEvents() should call after an interval time set on the BKTConfig.
When init ForeGround & BackGround Task, the Component should not be null.

https://github.com/bucketeer-io/ios-client-sdk/blob/main/Bucketeer/Sources/Internal/Scheduler/EventForegroundTask.swift#L8
https://github.com/bucketeer-io/ios-client-sdk/blob/main/Bucketeer/Sources/Internal/Scheduler/EvaluationForegroundTask.swift#L25

the problem seem happened from iOS 14

closed by https://github.com/bucketeer-io/ios-client-sdk/pull/28


Update arduino package from 1.0.6 to 1.6.5-r3

/cc @antono @robberer @bjornfor

There were some nontrivial changes to the build process, and all due credit to clever in the #nixos irc for helping me debug them.

I'm getting build failure:
$ nix-build -A arduino
...
untar-unzip-download:
      [get] Getting: http://downloads.arduino.cc/reference-1.6.0.zip
      [get] To: /tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/shared/reference-1.6.0.zip
      [get] Error getting http://downloads.arduino.cc/reference-1.6.0.zip to /tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/shared/reference-1.6.0.zip

untar-unzip-checksum:
     [echo] Testing checksum of "shared/reference-1.6.0.zip"
 [checksum] Could not find file /tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/shared/reference-1.6.0.zip to generate checksum for.

BUILD FAILED
/tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/build.xml:83: The following error occurred while executing this line:
/tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/build.xml:637: The following error occurred while executing this line:
/tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/build.xml:149: The following error occurred while executing this line:
/tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/build.xml:726: Could not find file /tmp/nix-build-arduino-1.6.5-r3.drv-0/Arduino-1.6.5-r3-src/build/shared/reference-1.6.0.zip to generate checksum for.

It's the same issue as in https://github.com/NixOS/nixpkgs/pull/6694.

Ah shoot, I hadn't found that PR when looking for anyone else having tried. Do you have any recommendations on how to fix it? I can think of some fairly complicated solutions like MitMing ant to deliver a local file, but ideally there's some better solution than that.

Not really. Just the generic "pre-download the file with nix and find a way to give the file to the package build system so that it doesn't try to fetch the file itself"...

As I try to fix this, how can I reproduce your error? The Travis build was successful.

Enable chroot builds in nix.

@joshuafcole I also updated Arduino to 1.6.5 (no rc).
Also managed to get the Digispark board working.
But my build is also fetching resources while in build phase. So I will work on that.

@brodul I am also interested in getting digispark working. How did you manage to get it working? Did you patch the additional libs after you downloaded them with the arduino gui? Or did you manage to automate this process with a nix package?

@d4g I patched them manually. Added myself to dialout group.
patchelf --set-interpreter /nix/store/mibabdfiaznqaxqiy4bqhj3m9gaj45km-glibc-2.21/lib/ld-linux.so.2 --set-rpath /nix/store/jkycidwj1m3ai9pr3xj078924rq0avmz-gcc-4.9.3/lib/ launcher
patchelf --set-interpreter /nix/store/483br9kb3f5igsgmb6aqsjhl2ipj2bxr-glibc-2.21/lib/ld-linux-x86-64.so.2 --set-rpath /nix/store/rfw2anwm0h7fz4gqjx3r9gr2dgkfdy0p-libusb-compat-0.1.5/lib  micronucleus

You also need to add some udev rules:
https://github.com/micronucleus/micronucleus/wiki/Ubuntu-Linux

@d4g I patched them manually. Added myself to dialout group.
patchelf --set-interpreter /nix/store/mibabdfiaznqaxqiy4bqhj3m9gaj45km-glibc-2.21/lib/ld-linux.so.2 --set-rpath /nix/store/jkycidwj1m3ai9pr3xj078924rq0avmz-gcc-4.9.3/lib/ launcher
patchelf --set-interpreter /nix/store/483br9kb3f5igsgmb6aqsjhl2ipj2bxr-glibc-2.21/lib/ld-linux-x86-64.so.2 --set-rpath /nix/store/rfw2anwm0h7fz4gqjx3r9gr2dgkfdy0p-libusb-compat-0.1.5/lib  micronucleus

You also need to add some udev rules:
https://github.com/micronucleus/micronucleus/wiki/Ubuntu-Linux

@joshuafcole care to update the PR with fixes from @brodul ?

Would be nice to get this into 16.03, which will branch off this weekend :)

Apologies for the slow response. I've been a bit swamped with work lately so haven't had time for my arduino and nix hobbies lately. I'm still interested in getting a newer arduino into nixpkgs, but, like @brodul, I solved the problems manually and have been using that. I unfortunately don't have the know-how in arduino's build process to avoid the package fetching step, and hosting it elsewhere and trying to circumvent it feels both fragile and shady. I took a quick look at @brodul's patch and don't see how that resolves @bjornfor's concern either (though if it does, fantastic!) If that's the case, I think he should be the one to get the credit for merging it into the mainline. If there's anything else I can do to help, please let me know.

@joshuafcole your observations are correct. It does not. Our branches are similar, but yours is cleaner. I will try to fix the issue, but I can't tell when, but definitely for the next stable release.

Closing in favour of https://github.com/NixOS/nixpkgs/pull/17060


Fix the android reset command https://github.com/appium/appium/issues…

As the fastReset option is not available, changing the if check to use fullReset.

Published in 1.7.2.


[BEAM-9573][release-2.20] Correct computing of watermark hold for timer output timestamp

Backport of #11200.
With the introduction of timer output timestamps, a new watermark hold had been
added to the Flink Runner. The watermark computation works on the keyed state
backend which computes a key-scoped watermark hold and not the desired
operator-wide watermark hold.
Computation: https://github.com/apache/beam/blob/b564239081e9351c56fb0e7d263495b95dd3f8f3/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java#L1140
Key-scoped state: https://github.com/apache/beam/blob/b564239081e9351c56fb0e7d263495b95dd3f8f3/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java#L1130
The solution is to iterate over all available state backend keys.

LGTM after necessary tests pass

@mxm any additional tests should run?

Run Flink Runner Nexmark Tests

Run Flink ValidatesRunner

I've already tested those, but running them again to make sure.

Run Flink Runner Nexmark Tests

Run Flink ValidatesRunner

I have backported both fixes now: BEAM-9573 and BEAM-9566 as they really only make sense together. One fixes a bug, the other one a performance regression.

Sounds good to me. Thanks!

Error prone errors in the build:
20:42:09 * What went wrong:
20:42:09 Execution failed for task ':model:pipeline:compileJava'.
20:42:09 > Could not resolve all files for configuration ':model:pipeline:errorprone'.
20:42:09    > Could not resolve com.google.errorprone:error_prone_core:latest.release.
20:42:09      Required by:
20:42:09          project :model:pipeline
20:42:09       > Could not resolve com.google.errorprone:error_prone_core:2.3.4-SNAPSHOT.
20:42:09          > Unable to load Maven meta-data from https://oss.sonatype.org/content/repositories/staging/com/google/errorprone/error_prone_core/2.3.4-SNAPSHOT/maven-metadata.xml.
20:42:09             > Could not HEAD 'https://oss.sonatype.org/content/repositories/staging/com/google/errorprone/error_prone_core/2.3.4-SNAPSHOT/maven-metadata.xml'. Received status code 502 from server: Bad Gateway
20:42:09

Run Portable_Python PreCommit

Run Java PreCommit

Run Flink Runner Nexmark Tests

Run Flink ValidatesRunner

Great! all tests have pass!

Awesome. Thanks for the patience!


Multi chain phase 1

This PR prepares the output of many RPC calls and makes them ready for multi-chain support.
While multi-chain support may come on a future date, it is important to make these changes now to prepare the API leyer for that change and avoid incompatibility in the future.

Hi Guys,
Can you please review this PR which is the first step of #1331
It prepares the system interfaces (commands, RPC) for multi-chain.
While multi-chain is not part of 0.5, changing the API as early as possible is the best fo the echo system.
Thanks
Offer

@sangaman Thanks for your review and feedback.  Before I implement the needed changes, can you please go over my responses to some of the comments.
Thanks
Offer

Your responses make sense to me. The only thing I'd still change is not printing the chain when an invoice is created via command line, but it's not a big deal. Also I haven't looked deeper into PendingChannelsCount, if you can just do len() over each chain in a simple way that would probably be best.

@sangaman Can you please take another look on this?
Thanks


fix: 修复高度自适应死循环问题

👀 PR includes

🐛 Bugfix

[x] Solve the issue and close #0

:tada: This PR is included in version @antv/s2-react-v1.7.0-alpha.2 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version @antv/s2-react-v1.8.0-alpha.1 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Pre robot load

We need to do some setup before we do the robot load. We at least need to do:

The preload setup e.g.

Some will be move and forget
Move and check e.g. detector

Reset robot errors - need a list of which errors are ok (make sure its well documented why they're ok)
Kill the smargon
Setup OAV for centring (including zoom level 1) see https://github.com/DiamondLightSource/python-artemis/issues/294

Note this is just pre-setup, not doing load or anything after

We're now reliably doing this on the beamline. Closing


[darwin] Security fixes

These are some unobjectionable commits split off from #38624. Will merge if it doesn't cause a mass rebuild.

Success on x86_64-darwin (full log)
Attempted: antlr, pbzx, xcbuild
Partial log (click to expand)
/bin/echo "installation done"
installation done
post-installation fixup
strip is /nix/store/kdff2gim6417493yha769kh00n63lnrw-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/lib  /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/bin  /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/sbin
patching script interpreter paths in /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7
/nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/bin/antlr: interpreter directive changed from "/bin/sh" to "/nix/store/r8bx3qf1bpncb14i9gzma4vr089pc3pv-bash-4.4-p19/bin/sh"
/nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/bin/antlr-config: interpreter directive changed from "/bin/sh" to "/nix/store/r8bx3qf1bpncb14i9gzma4vr089pc3pv-bash-4.4-p19/bin/sh"
/nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/sbin/pyantlr.sh: interpreter directive changed from "/usr/bin/env python" to "/nix/store/10f4qxb00wk9j6cicd9h1qzwqgnc36ji-python-2.7.14/bin/python"
moving /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/sbin/* to /nix/store/iydvypslm2gx6b1zqsr3hjlhivy5l3q7-antlr-2.7.7/bin

Success on x86_64-linux (full log)
Attempted: antlr, pbzx, xcbuild
Partial log (click to expand)
installing
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/669xmxd5qfj2fawk67smr4789r800nba-xcbuild-wrapper-0.1.2-pre
strip is /nix/store/j75dgadrff2d1fyc4fczmcgqkid2imdx-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/669xmxd5qfj2fawk67smr4789r800nba-xcbuild-wrapper-0.1.2-pre/bin
patching script interpreter paths in /nix/store/669xmxd5qfj2fawk67smr4789r800nba-xcbuild-wrapper-0.1.2-pre
checking for references to /tmp/nix-build-xcbuild-wrapper-0.1.2-pre.drv-0 in /nix/store/669xmxd5qfj2fawk67smr4789r800nba-xcbuild-wrapper-0.1.2-pre...
/nix/store/jvni0rrzgx60vgfm9zra8gi4664cl576-antlr-2.7.7
/nix/store/fnfj6d239v75g5wd9agk17qdfd5pmz30-pbzx-1.0.2
/nix/store/669xmxd5qfj2fawk67smr4789r800nba-xcbuild-wrapper-0.1.2-pre

Success on aarch64-linux (full log)
Attempted: pbzx, xcbuild
The following builds were skipped because they don't evaluate on aarch64-linux: antlr
Partial log (click to expand)
building '/nix/store/30nm0ya7yq65bfhki1fyl7hk478irskf-xcbuild-wrapper-0.1.2-pre.drv'...
installing
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/9g9mag7w2qmljc73xzrjh7zq2a7qhphg-xcbuild-wrapper-0.1.2-pre
strip is /nix/store/j7d4mr0ikv974ig7yzhknpsq288js4bs-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/9g9mag7w2qmljc73xzrjh7zq2a7qhphg-xcbuild-wrapper-0.1.2-pre/bin
patching script interpreter paths in /nix/store/9g9mag7w2qmljc73xzrjh7zq2a7qhphg-xcbuild-wrapper-0.1.2-pre
checking for references to /build in /nix/store/9g9mag7w2qmljc73xzrjh7zq2a7qhphg-xcbuild-wrapper-0.1.2-pre...
/nix/store/jmmpjmkvv6f7m88d2zyh673m6a6c9m8x-pbzx-1.0.2
/nix/store/9g9mag7w2qmljc73xzrjh7zq2a7qhphg-xcbuild-wrapper-0.1.2-pre

I think this might have broken pinentry.
Touch ./pinentry-mac-dhxutgwbgiovlqgwbodflwnujcsw/Build/Products/Release/pinentry-mac.app
    cd /private/tmp/nix-build-pinentry-mac-0.9.4.drv-0/source
    /usr/bin/touch -c ./pinentry-mac-dhxutgwbgiovlqgwbodflwnujcsw/Build/Products/Release/pinentry-mac.app

** BUILD SUCCEEDED **
installing
mv: cannot stat 'Products/Release/pinentry-mac.app': No such file or directory
builder for '/nix/store/r32yi5r0q50aznbig5yj10z7rhp1irgz-pinentry-mac-0.9.4.drv' failed with exit code 1

Okay. I forgot it doesn't use xcbuild. Fixing should be easy though, just export these two: SYMROOT=$PWD/Products OBJROOT=$PWD/Intermediates


Packages fails to import when system site-packages contain a different version

🐛 Bug
The package mixes imports from the user's site-packages and system's site-packages, which leads to import errors or other unexpected behavior.
To Reproduce

Install older version of pytorch-lightning as system package, e.g.:

sudo pip3 install pytorch-lightning==0.8.0

Install newer version of pytorch-lightning as user package, e.g.:

pip3 install pytorch-lightning==1.0.4 --user

Try to import the package:

Python 3.8.2 (default, Feb 26 2020, 02:56:10)
[GCC 7.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pytorch_lightning
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/mybot/.local/lib/python3.8/site-packages/pytorch_lightning/__init__.py", line 79, in <module>
    __import__('pkg_resources').declare_namespace(__name__)
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/__init__.py", line 2293, in declare_namespace
    _handle_ns(packageName, path_item)
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/__init__.py", line 2226, in _handle_ns
    loader.load_module(packageName)
  File "/usr/local/lib/python3.8/dist-packages/pytorch_lightning/__init__.py", line 53, in <module>
    from pytorch_lightning.core import LightningModule, data_loader
ImportError: cannot import name 'data_loader' from 'pytorch_lightning.core' (/home/mybot/.local/lib/python3.8/site-packages/pytorch_lightning/core/__init__.py)

Note that python prefers the user packages over system packages so the first import use a file in /home/mybot/.local/ while the others start with /usr/local/lib/ (system packages).
Lines from the relevant file /home/mybot/.local/lib/python3.8/site-packages/pytorch_lightning/core/__init__.py:
# for compatibility with namespace packages
__import__('pkg_resources').declare_namespace(__name__)

Expected behavior
The import use only one version of the package.
Environment
Standard Ubuntu 18.04 docker image with CUDA 10.
NAME="Ubuntu"
VERSION="18.04.3 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.3 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic

Pip version:
pip 20.2.4 from /home/tclbot/.local/lib/python3.8/site-packages/pip (python 3.8)

Pytorch: 1.6.0
Additional context
This scenario occurs in practice. My docker image contains preinstalled packages from requirements.txt installed as system packages. Additionally at the start of the pod I defensively run pip install -r requirements.txt, just in case my docker image was outdated. I use system packages as a sort of cache.
In my case the workaround is quite simple, but this bug can lead to other, much more confusing issues.

I think this is a general Python/PyPI issue, there is nothing we can do about it in PL...
You just need to uninstall the sudo version or use a virtual environment / Conda :]

That unbelievably disappointing, but it's not the first time I was misguided by python package management. I guess I will need to change my current workflow if that's a general issue.
Thanks for quick response.


Make the imported memory available in functions

Thanks for filing a feature request! Please fill out the TODOs below.
Feature
Hello, I need to access the imported memory inside a functions, then I realized the Caller only show exports, not imports, so I had a lot of trouble to get Wasmtime store working with MaybeUnit, this simple solution segfaults:
pub struct State {
    pub memory: Memory,
}

let state = MaybeUninit::<State>::uninit();
let mut store = Store::new(engine, state);

let memory_type = MemoryType::new(16, None);
store.data_mut().memory.write(Memory::new(&mut store, memory_type)?);

let store = unsafe {
    std::mem::transmute::<Store<MaybeUninit<State>>, Store<State>>(store)
};

// ...
let imports = [memory.into()];

// segfaults below
let instance = Instance::new(&mut store, &module, &imports)?;

Then I realized the issue is that there's no way for me transmute only the State, I need to transmute the Store which is not recommended, once rust doesn't guarantee the same memory layout:
assert_eq!(size_of::<Option<bool>>(), 1);
assert_eq!(size_of::<Option<MaybeUninit<bool>>>(), 2);

Actually I haven't find any way to use MaybeUnit that doesn't look hacky, and I want to avoid the usage of Option and unwraps in the code, once it bloats the binary with panic data.
Alternatives

Make the imported memory easily available inside Functions, ex: expose it in the Caller.
Use #[repr(C)] on Store, so we can safely transmute it.

Where possible I'd recommend avoiding unsafe. If things are segfaulting it's probably due to that, so for example you could store Option<Memory> instead of using MaybeUninit and then there's no need for transmute and this probably won't segfault.
Otherwise though is there a problem with storing the memory in State?

Otherwise though is there a problem with storing the memory in State?

There's no problem, is just there's no examples of that, and is not ergonomic as using exported memory, rust encourages the use of Typestate Pattern, where the state of an object guarantees it is valid. In this case I want to guarantee the memory ALWAYS exists, that's why I don't want to use Option.
One example is the NonZeroU32 by knowing the number is never zero, the rust compiler can do some neat optimizations:
https://play.rust-lang.org/?version=stable&mode=debug&edition=2021&gist=6778305b1980ec60413183a0a1127a4d
assert_eq!(size_of::<u32>(), 4);
assert_eq!(size_of::<Option<u32>>(), 8);
assert_eq!(size_of::<Option<NonZeroU32>>(), 4);

In my case I want to guarantee the memory always exists, I don't want to handle the Option::None everywhere, neither use unwrap() everywhere, that's ok if there's no other option, but I think this is something that should be supported somehow by wasmtime, once the Store owns the memory, makes sense I be able to store it together with the store.

One thing you could perhaps do is to create a dummy Memory with a throwaway Store which is placed within future Stores as they're created. That would then be overwritten to the "real" memory once the store is created. That way you can store just Memory without having to deal with Option and you won't have to deal with any unsafety either.


docs(contributing): Adding docs/developer.md page

Why is this PR required? What issue does it fix?:
This PR adds the page docs/developer.md. This also fixes the dead link in the CONTRIBUTING.md page which links docs/developer.md
What this PR does?:
The developer.md page includes instructions for setting up the development environment.
Does this PR require any upgrade changes?:
If the changes in this PR are manually verified, list down the scenarios covered::
Signed-off-by: Niladri Halder<EMAIL_ADDRESS>

Hi @akhilerm . I amended the previous commit and did a 'Resolve conversation' on the suggested changes. Also I re-requested a review from you.
Let me know if any of this violates best practices.

Hi @akhilerm . I amended the previous commit and did a 'Resolve conversation' on the suggested changes. Also I re-requested a review from you.
Let me know if any of this violates best practices.

@niladrih instead of amending the commits and force pushing., you can just push as new commits. This will help to review only the changes done.  The rest is good.

@niladrih instead of amending the commits and force pushing., you can just push as new commits. This will help to review only the changes done.  The rest is good.


[ButtonLinks] not accessible on Firefox

Description
Anchors, particularly ButtonLinks, are not usually tabbable in Firefox for macOS. Their :focus state also doesn't appear when using keyboard navigation.
Reproduction Steps

Go to a page with a ButtonLink (https://tds.telus.com/#!/ButtonLink)
On Firefox, use the tab key to navigate across the page's anchors
Firefox may not focus on any anchors depending on your native settings, see https://stackoverflow.com/questions/11704828/how-to-allow-keyboard-focus-of-links-in-firefox
Firefox also does not display :focus styles on ButtonLink at all, but webkit browsers do

Reproduction Percentage (if applicable)

10/10 times

Meta

[ ] TDS version: v0.32.0
[ ] Willing to develop solution
Original issue: https://telusdigital.atlassian.net/browse/DJR-609 h/t @amelcharai

Screenshots

Fixed in 0.34.7, 1.0.6<EMAIL_ADDRESS>and<EMAIL_ADDRESS>


fi-1472-host-banner

Added support for a banner. It looks for a banner.html.erb file and renders it if found in the main directory. The banner size is set within the template. @AlyssaWang helped me work in some changes to the Sidebar and Header to allow for the banner. The banner.html.erb file I included will be removed before merging - I added it to make running/testing easier.

Codecov Report

Merging #151 (ed5005c) into main (bb69e67) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #151   +/-   ##
=======================================
  Coverage   93.87%   93.87%
=======================================
  Files         109      109
  Lines        2744     2744
=======================================
  Hits         2576     2576
  Misses        168      168

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bb69e67...ed5005c. Read the comment docs.

The banner.html.erb file I included will be removed before merging - I added it to make running/testing this PR easier.

FYI @Jack-Fraser16 @Jammjammjamm I think that <style></style> issue is likely because we were trying to do something technically illegal by adding a style tag in the body (by putting it in the banner.html.erb, it gets embedded in the body).  That would probably be ok if we weren't using a @mui/styles, which I think might update the DOM somehow?  I pushed an update that inlines the styles in the banner and that seems to fix it for me?

I'm not sure how to test this in the context of a real test kit.  @Jammjammjamm could you take a look and approve if it looks good?
We'll want to remove that banner from this repo before merging too, correct?

This branch needs to get rebased on main, and the footer seems messed up:

I missed this in the review, sorry.  It looks like the change from 100vh to 100% is what messed this up.  I agree this looks bad and we should fix it.

Yeah, height was not being explicitly set to 100% in the 'wrapper' element, which waterfalled down into what height was available for the 'app' and where the footer was being pushed down to. Should be all set now, and I added the banner back in to test:

Something in this branch is making a horizontal scroll bar appear on the left side. I don't see it in main.

Something in this branch is making a horizontal scroll bar appear on the left side. I don't see it in main.

It was changing the paper style of the drawer. Should be fixed.


[INPUT REQUESTED] Support environments and approvals

I want to provide better support for environments and approvals.
For starters I think seeing a list of environments under the Settings tree, or in a new view would be good. Auto-complete of environments is already available.
What else would you like to see?

Settings tree makes sense, right next to secrets. All in one place would be nice, the Azure Functions extension is a good reference for this IMHO.
Would also like to be able to do polled refresh not just in status bar but in the workflows pane, though I realize this may come with an API rate limit if used too much, maybe just poll the most recent action.
BTW, I love the detachable nature of panes, I put my github actions here:


Not able to mount storage account located in other tenant using service principal

Hi,
I'm not able to mount an azure storage container located in a different tenant than the databricks workspace, using a service principal.
It works with SAS/account key but I don't want to use this.
I'm using the following code:
endpoint = "https://login.microsoftonline.com/" + tenandId + "/oauth2/token"
source = "abfss://" + adlsContainerName + "@" + adlsAccountName + ".dfs.core.windows.net/"
Connecting using Service Principal secrets and OAuth
configs = {"fs.azure.account.auth.type": "OAuth",
"fs.azure.account.oauth.provider.type": "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider",
"fs.azure.account.oauth2.client.id": applicationId,
"fs.azure.account.oauth2.client.secret": authenticationKey,
"fs.azure.account.oauth2.client.endpoint": endpoint}
Mounting ADLS Storage to DBFS
dbutils.fs.mount(
source = source,
mount_point = mountPoint,
extra_configs = configs)
When I use tenant_id= tenant id of databricks workspace, I get the following error:
ExecutionError: An error occurred while calling o292.mount.
: Operation failed: "Server failed to authenticate the request. Please refer to the information in the www-authenticate header.", 401, HEAD, https://storageaccountname.dfs.core.windows.net/raw/?upn=false&action=getAccessControl&timeout=90
at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:241)
at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:768)
at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:750)
at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.getFileStatus(AzureBlobFileSystemStore.java:831)
at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.getFileStatus(AzureBlobFileSystem.java:559)
at com.databricks.backend.daemon.dbutils.DBUtilsCore.verifyAzureFileSystem(DBUtilsCore.scala:772)
at com.databricks.backend.daemon.dbutils.DBUtilsCore.mount(DBUtilsCore.scala:720)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:380)
at py4j.Gateway.invoke(Gateway.java:295)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:251)
at java.lang.Thread.run(Thread.java:748)
When I use tenant_id= tenant id of the storage account, the mounting works, but I get the following error when reading from the mount:
AbfsRestOperationException: Operation failed: "This request is not authorized to perform this operation using this permission.", 403, HEAD, https://storageaccountname.dfs.core.windows.net/raw/test7?upn=false&action=getStatus&timeout=90

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 58d39e17-424d-1db6-f600-15f272bf3a7c
Version Independent ID: 653ad346-6d87-d5fd-43dd-1498d218f145
Content: Azure Blob storage - Azure Databricks
Content Source: databricks/data/data-sources/azure/azure-storage.md
Service: azure-databricks
GitHub Login: @mssaperla
Microsoft Alias: saperla

Thanks for leveraging Azure docs feedback channel to raise this question. This channel is reserved for ‘Azure docs’ feedback- for sharing doc feedback and suggesting content improvements. We didn't determine any changes for this documentation upon reviewing this feedback.
If your issue is specific to a use case, we request you to please reach out in forums like Microsoft Q&A or Stackoverflow. We have our engineers and other community members who will be happy to assist. Forums have a better suited audience for such queries. Once your issue is posted in forum, please do share the forum thread link here for tracking.
If you have a document which you are following and if you think it needs an update, please let us know about that here.
Thank you


Shaders don't mark any exposed properties as "Main Color"

This breaks any code that uses "someMaterial.color" without checking and forces implementation of code paths specifically for UnityGLTF materials.

Thanks — the ShaderGraphs in UnityGltf were compatible back to 2019.x where that didn’t exist, but now that we support 2021.x+ it’s a good idea to add that.
Worth noting that

breaks any code that uses "someMaterial.color" without checking

is a bit of a misnomer, code that doesn’t check it is already broken, not every shader even has a main color.

@pfcDorn we should also add to the docs that shader properties in UnityGltf always match their glTF spec names for ease of use


说未指定namespace。 我指定了啊

FAILURE: Build failed with an exception.

What went wrong:
A problem occurred configuring project ':wechat_kit'.

Could not create an instance of type com.android.build.api.variant.impl.LibraryVariantBuilderImpl.
Namespace not specified. Specify a namespace in the module's build file. See https://d.android.com/r/tools/upgrade-assistant/set-namespace for information about setting the namespace.

 If you've specified the package attribute in the source AndroidManifest.xml, you can use the AGP Upgrade Assistant to migrate to the namespace value in the build file. Refer to https://d.android.com/r/tools/upgrade-assistant/agp-upgrade-assistant for general information about using the AGP Upgrade Assistant.

在Android->app->build.gradle.  已经指定了。 AndroidManifest.xml 的package 也添加了   AGP也更新了。还是没用

这个插件要更新，插件添加这个namespace


Android Studio can't run emulators

Describe the bug
Android Studio can't run emulators, display: Not enough memory to run HAXM
Steps To Reproduce
Steps to reproduce the behavior:

install android-studio in environment.systemPackages
run android-studio
create an emulator
run the emulator
display Not enough memory to run HAXM

Expected behavior
Emulator can run
Screenshots

Additional context
Notify maintainers

@alapshin
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 ~/C/nixos-config   *~  nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.9-zen1, NixOS, 23.05 (Stoat), 23.05.20230204.0591d6b`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.2`
 - channels(root): `"home-manager, nixos-22.11"`
 - nixpkgs: `/nix/store/n14283gcxp1l2qj0h53lngw4rl4y9xkd-source`

How is this related to Nixpkgs?

But I still have many memory
 ~/Code  free -h
               total        used        free      shared  buff/cache   available
内存：       61Gi        35Gi       2.5Gi       3.4Gi        23Gi        22Gi
交换：       67Gi       170Mi        67Gi

Maybe it is because of missing some dependences.
I have enable libvirtd and installed bridge-utils

@yswtrue  sadly error from android studio is missleading
this happens when android studio cant access kvm device, this has happened to me in the past when i was using
systemd.enableUnifiedCgroupHierarchy = true
so I'd start by checking you permissions to /dev/kvm and see if in your configuration nothing else is using kvm device
if /dev/kvm device is missing check for intel_kvm or amd_kvm kernel modules ( depending on your hardware )

I have also set 'systemd.enableUnifiedCgroupHierarchy = falseand there is/dev/kvmand my user is inkvm` group.

and I can run emulator in Virtual Machine Manager

but in android-studio there is no kvm group

@yswtrue can you provide your configuration ?  otherwise I would suggest remove most of things from your configuration,.
something basic like this
environment.systemPackages = with pkgs; [ android-studio ] ;

works for me,  as in, I can run emulator
 nix-info -m
 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.10, NixOS, 23.05 (Stoat), 23.05.20230210.9943fcc`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.2`
 - channels(root): `"nixos-22.05"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

I have disable waydroid and libvirtd, and android-studio emulator works for me  now, but I can't running android-studio emulator and virtualbox emulator at tie same time.
Thank you very much.
@kirillrdy

closing as resolved, feel free to reopen

@kirillrdy i cannot disable libvirt, and android studio doesn't work because of that issue.


Fixes to Diaspora protocol handling

Don't quote/encode Protocol.build_send payload. It was doing it wrongly in the first place and also it's not necessary since Diaspora 0.6.
Fix identification of Diaspora protocol messages. This was not working in the case that the attributes in the  tag were in different order.

Current coverage is 91.27% (diff: 100%)

Merging #41 into master will decrease coverage by 0.01%

@@             master        #41   diff @@
==========================================
  Files            13         13
  Lines           700        699     -1
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits            639        638     -1
  Misses           61         61
  Partials          0          0

Powered by Codecov. Last update 163e93b...4ef1bb2


Attendance kiosk should only say tap, not tap or swipe

https://github.com/RoboJackets/apiary-nfc-reader/pull/10#pullrequestreview-611470681

Fixed in #1986 and #1989


Recommended use of ask is incorrect

From @mattbrictson on May 31, 2016 19:16
The documentation recommends this pattern:
set :database_password, ask('Enter the database password:', 'default', echo: false)

But this is wrong. The first argument to ask is supposed to be a variable name, not a prompt string. Technically the code still works (since the outer set overrides the implicit set within ask), but it is very misleading.
Copied from original issue: capistrano/documentation#192

Hey there. I want to fix this one. But, as stated, the docs are really misleading.
The signature for ask is ask(key, default=nil, options={}) and in the end it works "fine" because I18n's default_question is question_default: "Please enter %{key} (%{default_value}): ", so, yes, the "key" is there.
What should be the recommended way to ask questions with a prompt string? Or should it just be explicit that an outer set would to the job in such situations?

There is no official way to ask a question with a custom prompt string. The technique currently in the docs is a hack, IMHO, and has no test coverage. My suggestion would be to change the docs so that it only explains these patterns:
ask(:database_encoding, "UTF-8")
ask(:database_password, "default", echo: false)

If the docs also show an example of what the default prompts look like, that would make this feature is easier to understand.
As an aside, if we want to officially support custom prompts, then perhaps that could be a separate PR. It could be another supported option, like:
ask(:database_encoding, "UTF-8", prompt: "My custom question prompt: ")

Fixed in #1924


Allow changing the Translate Text Instance ID into a sensible name from the start

The Translate Text extension has a flaw whereby the option to change the instance ID to a sensible name only shows up if the ID ‘firestore-translate-text’ is already taken. If not, we cannot change the instance ID.
Since we cannot change the instance ID once the extension is installed, we are stuck with an instance with a generic name of which, to see what it does, we have to open the configuration every time.

So the issue is the annoyance of there always being this instance of which we do not know what it translates because it has a generic name.
As a workaround I have reconfigured the firebase-translate-text instance to translate nothing. I have given it a collection path and input field name that dont exist. In this way, I get to ignore the generic instance because it doesnt do anything while the option to rename my instance IDs now becomes available.
Of course, it is rather silly that I have to do that. I cannot think of a good reason why the option to rename an instance ID should only show up if ‘firebase-translate-text’ is already taken.
What I would like is that the option to rename an instance ID is always available so that all instances of the extension can have sensible names.

Hi there, thanks for raising this, I think it's a great suggestion. I've raised a feature request with the extensions team. Having the option to rename instances through the console would be useful.
As a workaround for now I believe you can also change the name when you install an extension programmatically, through the manifest -

Moving to blocked until an existing solution can be found.

Thank you cabljac and dackers86.


osx-arm64

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The source section contained an unexpected subsection name. skip is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

For recipe:

License is not an SPDX identifier (or a custom LicenseRef) nor an SPDX license expression.

Documentation on acceptable licenses can be found here.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

For recipe:

License is not an SPDX identifier (or a custom LicenseRef) nor an SPDX license expression.

Documentation on acceptable licenses can be found here.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

That was fast! I guess someone found the time to port it after all!

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The outputs section contained an unexpected subsection name. activate_in_script is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The build section contained an unexpected subsection name. activate_in_script is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

Hi! This is the friendly automated conda-forge-linting service.
I wanted to let you know that I linted all conda-recipes in your PR (recipe) and found some lint.
Here's what I've got...
For recipe:

The outputs section contained an unexpected subsection name. target is not a valid subsection name.
The outputs section contained an unexpected subsection name. target is not a valid subsection name.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Impressive as usual @isuruf! Well done and huzzah!
cc @conda-forge/core

Nice! So we can now build Fortran things on macOS ARM or is there still more to do there?

Awesome @isuruf !

does this include these fixes? https://twitter.com/fxcoudert/status/1302564426206375942

@wolfv, not yet.


ListInstances of of openstack provider example returns invalid json array

ListInstances in https://github.com/cloudbase/garm/blob/main/contrib/providers.d/openstack/garm-external-provider returns a sequence of json objects but not a json array. Guess we need to encapsulate the whole jq string in '[...]', right?
echo ${INSTANCES} | jq -r '[
        .[] | .Properties * {
            provider_id: .ID,
            name: .Name,
            status: {"ACTIVE": "running", "SHUTOFF": "stopped", "BUILD": "pending_create", "ERROR": "error", "DELETING": "pending_delete"}[.Status]
        }]'

Indeed. It is a typo on my part. Will push a fix soon.

Also, make sure you use a recent version of the openstack clients (I installed from pip). Older versions seem to return properties as a string instead of a dict.


GridSpec error: Expected the given number of height ratios to match the number of rows of the grid

Hello, I am trying to run viscm with python -m viscm edit and encountering the following error. I'm on OSX with python 3.5.2 and have viscm 0.7 installed with pip install viscm.
Traceback (most recent call last):
  File "/usr/local/Cellar/python3/3.5.2_3/Frameworks/Python.framework/Versions/3.5/lib/python3.5/runpy.py", line 184, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/Cellar/python3/3.5.2_3/Frameworks/Python.framework/Versions/3.5/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/viscm/__main__.py", line 8, in <module>
    main(sys.argv[1:])
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/viscm/gui.py", line 898, in main
    v = viscm_editor(uniform_space=uniform_space, **params)
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/viscm/gui.py", line 456, in __init__
    axes = _viscm_editor_axes()
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/viscm/gui.py", line 441, in _viscm_editor_axes
    height_ratios=[6, 1])
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/matplotlib/gridspec.py", line 217, in __init__
    height_ratios=height_ratios)
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/matplotlib/gridspec.py", line 47, in __init__
    self.set_height_ratios(height_ratios)
  File "/Users/alden/code/upstream/colormaps/.venv/lib/python3.5/site-packages/matplotlib/gridspec.py", line 76, in set_height_ratios
    raise ValueError('Expected the given number of height ratios to '
ValueError: Expected the given number of height ratios to match the number of rows of the grid

Any thing I can do to fix it? Thank you!

Hit the same problem, the related code is (in gui.py):
def _viscm_editor_axes():
    grid = GridSpec(1, 2,
                    width_ratios=[5, 1],
                    height_ratios=[6, 1])

The "height_ratios" specification is not very meaningful since it is 1x2 grid.
Without understanding the resting code, my quick fix is to make it a 2x2 grid:
def _viscm_editor_axes():
    grid = GridSpec(2, 2,
                    width_ratios=[5, 1],
                    height_ratios=[6, 1])


chore(test): add another test case for ref

adds test for the missing use case (i hope so) in #65

@dai-shi i'm assuming this will cover that last test case. Let me know if not

Looks good. Thanks for your contribution!
We may want to have separate tests/ref.test.tsx? what do you think?

Yes i agree, ill open another PR soon to move the ref related tests to a new file. 👌


add wind qc

see #20

:shoe:: next step is do figure out have to handle calm and baffling winds (#20)

👞: next step is to figure out how to handle calm and baffling winds (#20)

This issue is fixed in https://github.com/glamod/cdm_reader_mapper/pull/82
A new issue was created: https://github.com/glamod/cdm_reader_mapper/issues/87


acme/autocert: missing server name

I've the same issue of that issue https://github.com/suyashkumar/ssl-proxy/issues/36, and i'm trying using the last version of ssl-proxy-linux-amd64 realese 0.2.7 and building from source with last commit 09cb9a.
The ssl-proxy was running fine, then i stopped, and when i started ssl-proxy again, show that error.
Using my cert and key works fine.

thanks for reporting! Last time, this was fixed with updating the golang crypto dependencies (I have a PR open for that here that you can try: #46). If that doesn't work I'll take a closer look this week!

thanks for reporting! Last time, this was fixed with updating the golang crypto dependencies (I have a PR open for that here that you can try: #46). If that doesn't work I'll take a closer look this week!

It worked, thanks!