Using Matlab ascii files vs. binary files

Currently most data is written to the input directory of STEMMUS_SCOPE as ascii files. However, these are both larger as well as slower when reading and writing.
If it is viable for us to change this in the Matlab code, we probably should to make the pre-processing and model runs more efficient.

With regards to netcdf files, we need to check which function is faster by Matlab: ncread or load
I vote to use binary files. It would be also nice if we could inspect the performance (runtime and memory usage) of stemuus_scope model when using binary files and not csv files.

I tried to benchmark the performance of writing mat files (v.7.3 HDF format) vs. writing netCDF files on my local machine;

n_data
1e3
1e4
1e5
2e5

xr.to_netcdf
3
3
3,5
4

hdf5storage.savemat
4
6
23
45

Times in ms, using %%timeit. n_data represents the size of the random.rand numpy array.
Writing to netCDF does seem to be a lot more efficient. The netCDF file sizes are a bit smaller as well (1.5 vs 3 MB for the biggest set of random data).
As we generally will be in the 1e5 - 4e5 data points range (5 - 20 years of data), our write times are probably not something to worry about. I will test the read performance of ncread and load to see if there is a significant difference here.

Apart from the performance, I think interoperability (and the use of open/standard formats) is another argument in favour of netcdf.


Get a phone booth in the Stavros Niarchos Foundation library

Is your feature request related to a problem? Please describe.
The Stavros Niarchos Foundation library doesn't have spaces for remote workers to take calls, which single-handedly disqualifies it as an otherwise wonderful/free coworking space.
Pictures and screenshots
Describe the solution you'd like
I want to get the SNFL to put in at least one phone booth.
Describe alternatives you've considered
Instead of a phone booth, which has potential security concerns (especially if an off-kilter individual got in one), the library could designate one of their many class/seminar rooms as a "loud room" for people to take calls.
Tasks
Include specific tasks in the order they need to be done.

[x] Email the Stavros Niarchos Foundation to ask if a phonebooth would be possible, if they could recommend the library add one, or if they have suggestions on who to contact besides them (https://www.snf.org/en/contact/contact-us/). Include link to Priya's piece.
[ ] Call the NYPL laying out the same items as in the above (https://www.nypl.org/help/about-nypl/administration/contact-list). Looks like the best contact would be "Strategic Planning // Daphna Blatt, Senior Director, Strategy & Public Impact //<PHONE_NUMBER>"

Budget, Labor, and Bill of Materials
Follow-up emails of support after initial contact is successfully made. For example, I would drop a note in the MNY Discord asking everyone to send emails saying how they love the SNFL, and would love it even more with a phone booth/loud room.

I sent the following email:

SUBJECT: Phone booth/loud room in the Stavros Niarchos Foundation Library

"Dear All,
My friends and I all love working at the library you generously support in Midtown--it's truly a game changer for us and so many others, and it's at the top of the resource list I share with friends. So...thank you!
One thing I was wondering: would it be possible to install a phone booth or designate one of the classroom spaces as a "loud room" where people could take calls? It would open the library up to many more people, and fundamentally change their experience of the library. I'm sure there are challenges that would come with this, and my friend Priya wrote about them here, but I'd love to help make it happen if possible.
What do you think?
Best,
Daniel Golliher"


Problem Adding new Language

Sorry if this is not the correct place. I didn't found a forum or mail group to post questions.
I was trying to add a new language (Go) to beaker but I can't understand the requirements and which files to change, the documentation is not very clear to me. Is there a place to ask for new language support? or at least someone who could give me some directions.
Thanks

This is a good place to start at least.  Did you see https://github.com/twosigma/beaker-notebook/wiki/How-to-Add-a-Language-to-Beaker yet?

Yes, o copied the Groovy folder and changed the name to Golang. Also I
edited the two files inside, the .js and the python script, replacing all
groovy entries to golang.
On Thu, Sep 17, 2015 at 1:39 PM Scott Draves<EMAIL_ADDRESS>wrote:

This is a good place to start at least. Did you see
https://github.com/twosigma/beaker-notebook/wiki/How-to-Add-a-Language-to-Beaker
yet?
—
Reply to this email directly or view it on GitHub
https://github.com/twosigma/beaker-notebook/issues/2373#issuecomment-141162429
.

what about core/src/main/web/plugin/init/addevalplugins.js did you update that?
what is not working?

got your e-mail
On Thu, Sep 17, 2015 at 1:44 PM Scott Draves<EMAIL_ADDRESS>wrote:

what about core/src/main/web/plugin/init/addevalplugins.js did you update
that?
what is not working?
—
Reply to this email directly or view it on GitHub
https://github.com/twosigma/beaker-notebook/issues/2373#issuecomment-141163439
.

If the language does not appear in the language plugin UI then the entry is missing from addevalplugin.js or the golang.js is not found or has an error inside
If the language does appear but the backend is not started then it might be that the COMMAND in the golfing.js is incorrect or the path is built (server side) incorrectly. You should have a message on the console to see what happened.

I added the following line to the addevalplugin.js file:
"Golang": { url : "./plugins/eval/golang/golang.js", bgColor: "#005e99",
fgColor: "#FFFFFF", borderColor: "", shortName: "Go" }
Then, after starting the server and choosing Go on the language manager I
get this on the terminal:
Connecting to http://<IP_ADDRESS>:8801/
restart-nginx-Golang-stderr>nginx: [alert] could not open error log file:
open() "/var/log/nginx/error.log" failed (13: Permission denied)
restart-nginx-Golang-stderr>2015/09/17 13:48:03 [notice] 7150#0: signal
process started
Running
0: /home/felipevl/bin/beaker/config/plugins/eval/golang/golangPlugin
1: 8804
Golang-stderr>Traceback (most recent call last):
Golang-stderr>  File
"/home/felipevl/bin/beaker/config/plugins/eval/golang/golangPlugin", line
32, in
Golang-stderr>    os.execlp(bin, bin, port)
Golang-stderr>  File "/usr/lib/python2.7/os.py", line 327, in execlp
Golang-stderr>    execvp(file, args)
Golang-stderr>  File "/usr/lib/python2.7/os.py", line 344, in execvp
Golang-stderr>    _execvpe(file, args)
Golang-stderr>  File "/usr/lib/python2.7/os.py", line 368, in _execvpe
Golang-stderr>    func(file, *argrest)
Golang-stderr>OSError: [Errno 2] No such file or directory
Done starting Golang
nginx-stderr>2015/09/17 13:48:03 [error] 7154#0: *78 connect() failed (111:
Connection refused) while connecting to upstream, client: <IP_ADDRESS>,
server: , request: "GET /37d7759/golang.281063586231/rest/golangsh/ready
HTTP/1.1", upstream: "http://<IP_ADDRESS>:8804/rest/golangsh/ready", host: "
<IP_ADDRESS>:8801", referrer: "http://<IP_ADDRESS>:8801/beaker/"
nginx-stderr>2015/09/17 13:48:03 [error] 7154#0: *78 connect() failed (111:
Connection refused) while connecting to upstream, client: <IP_ADDRESS>,
server: , request: "GET /37d7759/golang.281063586231/rest/golangsh/ready
HTTP/1.1", upstream: "http://<IP_ADDRESS>:8804/rest/golangsh/ready", host: "
<IP_ADDRESS>:8801", referrer: "http://<IP_ADDRESS>:8801/beaker/"
nginx-stderr>2015/09/17 13:48:03 [error] 7154#0: *78 connect() failed (111:
Connection refused) while connecting to upstream, client: <IP_ADDRESS>,
server: , request: "GET /37d7759/golang.281063586231/rest/golangsh/ready
HTTP/1.1", upstream: "http://<IP_ADDRESS>:8804/rest/golangsh/ready", host: "
<IP_ADDRESS>:8801", referrer: "http://<IP_ADDRESS>:8801/beaker/"
On Thu, Sep 17, 2015 at 1:50 PM Davide Pasetto<EMAIL_ADDRESS>wrote:

If the language does not appear in the language plugin UI then the entry
is missing from addevalplugin.js or the golang.js is not found or has an
error inside
If the language does appear but the backend is not started then it might
be that the COMMAND in the golfing.js is incorrect or the path is built
(server side) incorrectly. You should have a message on the console to see
what happened.
—
Reply to this email directly or view it on GitHub
https://github.com/twosigma/beaker-notebook/issues/2373#issuecomment-141164866
.

Execute  "/home/felipevl/bin/beaker/config/plugins/eval/golang/golangPlugin 8804" on the command line and see why it is failing. It seems line 32 is wrong

Traceback (most recent call last):
File "./golangPlugin", line 32, in
os.execlp(bin, bin, port)
File "/usr/lib/python2.7/os.py", line 327, in execlp
execvp(file, args)
File "/usr/lib/python2.7/os.py", line 344, in execvp
_execvpe(file, args)
File "/usr/lib/python2.7/os.py", line 368, in _execvpe
func(file, *argrest)
OSError: [Errno 2] No such file or directory

Hum, I have a file inside the bin/ folder, called Golang, there was a type (s/Golang/golang).
I got this from the Groovy folder, i guess its configured to the Groovy language only


Components without DOM nodes

Is it possible?
I'd like to write some components to set the document title and meta tags. I figured this can be done with a component that renders nothing, but performs document.querySelector('title').textContent = '...' or similar.

Here's what happens today:
Component = { render() { return '' } }

render(tree(<Component />), document.body)
// Error: Render function must return an element.

I'd probably have that as state outside of the component tree. It's not really related to the UI as much as it is the URL, and the URL is just a blob of context state.
In v2, using Deku alongside Redux, I'd have some middleware that handles the document.title change as a side-effect to a URL state change.

Curious: did you mean Deku v2 would have a hard dependency to redux?

Nope, just using it alongside it to manage state. v2 makes it easy to use something like Redux, but you don't have to.

nice. :)
for what its worth, I was able to do this:
// <DocumentMeta title={ "Hello" } />
module.exports = { render, afterUpdate }

function render () {
  return []
}

function afterUpdate({ props }) {
  const { title } = props
  setTitle(title)
}

function setTitle (title) {
  if (typeof document === 'undefined') return
  const el = document.getElementsByTagName('title')[0]

  if ('textContent' in el) el.textContent = title
  else el.innerText = title
}

Yup that'd be the best solution. The lifecycle hooks are there for side-effects like that :)

...and this isn't really related to the issue, but I just want you to know that I'm really loving Deku so far.
If you're curious how your users utilize Deku: I've managed to hook up a setup with deku, redux, deku-redux and riot-route. All the router does is dispatch an action to the redux store, so everything is neatly and functionally rendered by a Deku tree from a Redux store.


no /XO option?

Can't figure out a way to not copy files that already exist in the destination. I tried sync but that just fails and never returns control to the console.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 15911160-5ba2-fb0a-0b24-16b3857e20ce
Version Independent ID: d925bc9f-f825-2f82-168c-6c30d716b9ce
Content: Copy or move data to Azure Storage with AzCopy v10 (Preview)
Content Source: articles/storage/common/storage-use-azcopy-v10.md
Service: storage
GitHub Login: @artemuwka
Microsoft Alias: artemuwka

@gatornation11 Thank you for the valuable feedback,we are investigating the issue.

@gatornation11  You should be careful in using the sync option, what it does is: "For sync, last modified times are used to determine whether to transfer the same file present at both the source and the destination.
If the use case is to incrementally transfer data, then sync is the better choice, since only the modified/missing files are transferred."
Meaning it would delete the files in blob storage which do not exist on the source location.
Are you looking to upload files that do not exist on Azure blobs or Azure File Share ? I'll help you with a quick around.

Yes, that is basically what I want to do. The full story.
Setup up a “azcopy cp” with a PS wrapper. The box it was running on rebooted.
Since that happened I don’t have the full copy complete.
I don’t to recopy what is already up there, that seems inefficient AND there doesn’t appear to be an /XO option with v10.
So I thought I would do the sync option to get the files that didn’t make it on the first try.
By the way, when I do the sync options it stops here.
<EMAIL_ADDRESS>Is that expected? Been sitting there for hours….why is it saying 0 files scanned at the source?
Also the log file it says it created isn’t there. I supposed that won’t flushed to disk until the job is done…but it doesn’t appear that it will ever end.
From: Adam-Smith-MSFT<EMAIL_ADDRESS>Sent: Monday, February 25, 2019 1:58 PM
To: MicrosoftDocs/azure-docs<EMAIL_ADDRESS>Cc: Eric Logeson<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/azure-docs] no /XO option? (#25674)
@gatornation11https://github.com/gatornation11 You should be careful in using the sync option, what it does is: "For sync, last modified times are used to determine whether to transfer the same file present at both the source and the destination.
If the use case is to incrementally transfer data, then sync is the better choice, since only the modified/missing files are transferred."
Meaning it would delete the files in blob storage which do not exist on the source location.
Are you looking to upload files that do not exist on Azure blobs or Azure File Share ? I'll help you with a quick around.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/azure-docs/issues/25674#issuecomment-467135768, or mute the threadhttps://github.com/notifications/unsubscribe-auth/Ac61puUINynZqXM6uN-7MWlTzFkpYzPBks5vRDJMgaJpZM4bQKOL.

update on trying to sync.
C:\azcopy_windows_amd64_10.0.7>azcopy sync --recursive "E:" "https://(redact).blob.core.windows.net/(redact)?(sas key)"
Job a8f206ac-6a43-794c-4177-dbefee94fc41 has started

Log file is located at: C:\Users\username/.azcopy/a8f206ac-6a43-794c-4177-dbefee94fc41.log
Sync has enumerated 299445 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: n
******** why is this wanting to delete the files in the destination?
0 File Scanned at Source, 299445 Files Scanned at Destination
error performing the sync between source and destination. Failed with error error starting the sync between source E: and destination https://(redact.blob.core.windows.net/(redact). Failed with error cannot start job because there are no transfer to upload or delete. The source and destination are in sync
---------now it says it's in sync?
No log file was created. The output of this is very confusing, I can't reconcile the output of the command. the content between the * vs the content between the - seem to contradict each other.

update on trying to sync.
C:\azcopy_windows_amd64_10.0.7>azcopy sync --recursive "E:" "https://(redact).blob.core.windows.net/(redact)?(sas key)"
Job a8f206ac-6a43-794c-4177-dbefee94fc41 has started

Log file is located at: C:\Users\username/.azcopy/a8f206ac-6a43-794c-4177-dbefee94fc41.log
Sync has enumerated 299445 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: n
******** why is this wanting to delete the files in the destination?
0 File Scanned at Source, 299445 Files Scanned at Destination
error performing the sync between source and destination. Failed with error error starting the sync between source E: and destination https://(redact.blob.core.windows.net/(redact). Failed with error cannot start job because there are no transfer to upload or delete. The source and destination are in sync
---------now it says it's in sync?**
No log file was created. The output of this is very confusing, I can't reconcile the output of the command. the content between the * vs the content between the - seem to contradict each other.

update on trying to sync.
C:\azcopy_windows_amd64_10.0.7>azcopy sync --recursive "E:" "https://(redact).blob.core.windows.net/(redact)?(sas key)"
Job a8f206ac-6a43-794c-4177-dbefee94fc41 has started

Log file is located at: C:\Users\username/.azcopy/a8f206ac-6a43-794c-4177-dbefee94fc41.log
Sync has enumerated 299445 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: n**
******** why is this wanting to delete the files in the destination?
0 File Scanned at Source, 299445 Files Scanned at Destination
error performing the sync between source and destination. Failed with error error starting the sync between source E: and destination https://(redact.blob.core.windows.net/(redact). Failed with error cannot start job because there are no transfer to upload or delete. The source and destination are in sync
---------now it says it's in sync?**
No log file was created. The output of this is very confusing, I can't reconcile the output of the command. the content between the * vs the content between the - seem to contradict each other.

update on trying to sync.
C:\azcopy_windows_amd64_10.0.7>azcopy sync --recursive "E:" "https://(redact).blob.core.windows.net/(redact)?(sas key)"
Job a8f206ac-6a43-794c-4177-dbefee94fc41 has started

Log file is located at: C:\Users\username/.azcopy/a8f206ac-6a43-794c-4177-dbefee94fc41.log
Sync has enumerated 299445 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: n
******** why is this wanting to delete the files in the destination?
0 File Scanned at Source, 299445 Files Scanned at Destination
error performing the sync between source and destination. Failed with error error starting the sync between source E: and destination https://(redact.blob.core.windows.net/(redact). Failed with error cannot start job because there are no transfer to upload or delete. The source and destination are in sync
---------now it says it's in sync?**
No log file was created. The output of this is very confusing, I can't reconcile the output of the command. the content between the * vs the content between the - seem to contradict each other.

Tried to un bold that section, deleted copy paste from notepad, what a pain...

@gatornation11 This could be a connectivity issue,
I wrote I python script: compare-upl-del-temp.py: in  https://github.com/adamsmith0016/Azure-storage/blob/master/README.md
Which provides you with the answer to the steps you mentioned, feel free to mold it based on your requirements as well.  all you need to put in on the script are mentioned in the Readme section.
Let me know if this helps.

@gatornation11  was the script helpful to you by any chance ?

I haven't tried it sorry. Before I got your script I deleted the blob and I'm trying again. I think I know why the  sync option was wanting to delete files, long story won't bore you with that.
to compare I'm doing this at the end.
$ctx = New-AzureStorageContext -StorageAccountName containername -storageAccountKey xxxxxxxxxxx
$blobs = Get-AzureStorageBlob -Container containername -Context $ctx
$blobs | measure
this give me a file count for the container. This works  okay for me now.

Let me know in case if you need any help or if I could close this issue for now.
Thanks,
Adam

Please close.
From: Adam-Smith-MSFT<EMAIL_ADDRESS>Sent: Tuesday, February 26, 2019 5:33 PM
To: MicrosoftDocs/azure-docs<EMAIL_ADDRESS>Cc: Eric Logeson<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/azure-docs] no /XO option? (#25674)
Let me know in case if you need any help or if I could close this issue for now.
Thanks,
Adam
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/azure-docs/issues/25674#issuecomment-467641774, or mute the threadhttps://github.com/notifications/unsubscribe-auth/Ac61pjDbC-JL7R5DzGKRMIjAXLLePeU0ks5vRbYAgaJpZM4bQKOL.

We will now proceed to close this thread. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


Allow package consumer to set MS Graph origin

Lightweight solution that allows consumer of odsp-driver package to run against a different MS Graph instance, such as PPE or Canary.

Closing in favor of this solution:
https://github.com/microsoft/FluidFramework/pull/4372/files


Leading/Trailing Comments - can they go away now?

The Leading/Trailing Comment Doc types were originally added to make it easier to ensure line breaks were added around comments appropriately. With the changes from https://github.com/belav/csharpier/issues/22 it seems like LeadingComments could go away. Partly this depends on how we treat new lines long term. See https://github.com/belav/csharpier/issues/40
TrailingComment could also potentially go away but would probably require more work.
If we do keep them, document them because it isn't clear right now why they are needed.

I originally thought prettier couldn't handle comments very well, but after some testing it can. I may be getting it confused with the old csharper prettier plugin. Digging into how they deal with leading/trailing comments should help.
the Trim doc type will probably be needed to handle directives.
There are a whole lot of edge cases that cascade into each other when I tried working on this the first time.

I'm hoping while doing this we can get rid of the before/after parameters for printing syntax tokens, as well as the SpaceIfNoPreviousComment doc type.

I got no where trying to get rid of LeadingComment because of all the edge cases. The problem is that when you print a leading comment you want to add a new line, but only if there isn't already a new line before it. That is hard to figure out in the SyntaxPrinter because of all the edge cases, but incredibly easy to figure out in the DocPrinter.
Prettier's comment printing is super complex from what I saw. It also does sometimes move comments around, like
for // would anyone really do this?
(var x in GetSomething()) {
    return;
}
// is prettiered as
for (// would anyone really do this?
var x in GetSomething()) {
  return;
}

Right now csharpier leaves comments where they are and I haven't run into any cases where it seems like they should be moved.
foreach // would anyone really do this?
(var x in GetSomething())
{
    return;
}

The code in DocPrinter/Token continues to get uglier. There are a ton of weird edge cases handled now and the Docs have too many special cases that make it hard to understand. This is how we print a directive now.
                    docs.Add(
                        // adding two of these to ensure we get a new line when a directive follows a trailing comment
                        Doc.HardLineIfNoPreviousLineSkipBreakIfFirstInGroup,
                        Doc.HardLineIfNoPreviousLineSkipBreakIfFirstInGroup,
                        Doc.Trim,
                        Doc.Directive(triviaText),
                        Doc.HardLineSkipBreakIfFirstInGroup
                    );

It works but is getting harder and harder to understand. Would we be better off not trying to do these so generically? Maybe we don't have anymore edge cases to handle?


Front-page should not show a "Stake" button on my own projects

https://stakes.social/, it shows "chalk" with a "Stake" button in the box, but I'm the author, so I should not be encouraged to stake my own project.

I agree because this is a confusing feature. It requires handling that AssetItemOnList does.
https://github.com/dev-protocol/stakes.social/blob/68f4ac710c81578687c1fb39efb902455662e4e8/packages/web/src/components/molecules/AssetItemOnList/index.tsx#L107
https://github.com/dev-protocol/stakes.social/blob/68f4ac710c81578687c1fb39efb902455662e4e8/packages/web/src/components/molecules/AssetItemOnList/index.tsx#L133-L137


Testing

This design issue is about the ASO testing setup. Usage of requirements key words as per RFC 2119.
Scope
One of our tenets is that ASO is optimized for production usage. This requires that we have a set of test suites in place. In scope for this issue is the selection of the nature of the tests carried out as well as the design of the test infrastructure.
Input
Suggested tests include (but are not limited to):

Unit-level tests in Go.
Per-AWS-service test: checks to what extent an ASO for a certain service covers the operations supported by said service.
Performance and scale tests: to figure out the ASO behaviour under short-term load.
Soak tests: to figure out the ASO behaviour under long-term load.

Requirements

Tests in ASO MUST be automated. All results SHOULD be surfaced as bot messages on GitHub issues.
Every ASO graduating to GA MUST have full test coverage.
The selection of tests, documentation thereof, as well as the test infrastructure MUST be completed before implementation begins.

Is this project sponsored? Can AWS provide testing infrastructure/credit to run CI for this?
Do we want to rely on mocks for some of the tests? Will everything be run "for real" in AWS?
Is there Slack infrastructure setup for this?

* Is this project sponsored? Can AWS provide testing infrastructure/credit to run CI for this?

Yes, e2e tests will be run on AWS infrastructure and will gate commits to the repo.

* Do we want to rely on mocks for some of the tests? Will everything be run "for real" in AWS?

Both :) Fast/unit tests with mocks are good. e2e functional integration tests against real AWS resources are also good.

* Is there Slack infrastructure setup for this?

Not yet :) Would you recommend a separate channel or use an existing one?

Not yet :) Would you recommend a separate channel or use an existing one?
I'd like to see a dedicated #aws-service-operator channel on the official kubernetes.slack.com Slack.

Per-AWS-service test: checks to what extent an ASO for a certain service covers the operations supported by said service.

I am just curious about this test, will these tests run with the actual AWS services ? Or is there any plan to use the mock service such as localstack for faster feedback?
Another consideration is about the discrepancies in features that we have in different regions.

The tests SHOULD run against the actual APIs and not against local emulations.

Some more details on a testing plan...
We are going to modify the e2e integration test setup in the AWS VPC CNI plugin repository that uses the aws-k8s-tester binary for initial setup of the Kubernetes cluster.
Modifications we need to make to this script include:

Setting up this repository in CircleCI similar to the configuration in CNI plugin
Generating an e2e test for simple CRUD+L operations for resources in each generated service controller
Modify the main e2e test runner script to allow for each service controller binary to be built into its own Docker image and pushed to an ECR repository and installed into the Kubernetes cluster created by aws-k8s-tester eks create cluster
Develop a way for individual service teams to extend the set of integration tests that we generate
Lots of documentation

Can we assign someone?

Closing this out. We ended up building our own simple Bash-based integration testing framework and each service controller has its own set of e2e tests that are run in a manual self-hosted GitHub runner.
There is a separate issue for a long-running soak test.
And we have documented release criteria related to testing of individual service controllers.


Release mode / Testflight builds not connecting

Hi! I figured I would repost this here:
https://github.com/dotintent/react-native-ble-plx/issues/997
Has anybody deployed this in release mode without BLE issues?
When I run my code in debug mode, I can scan and discover my peripheral.
When I run my code in release mode, I am unable to scan or discover my peripheral.
    "react-native": "0.68.2",
    "react-native-ble-plx": "^2.0.3",

I used this as a reference: https://github.com/PlayerData/react-native-mcu-manager/blob/main/example/src/useBluetoothDevices.ts#L6
scannedDevice comes back as nil, and e is defined as [BleError: BluetoothLE is in unknown state]

I have added 'Uses Bluetooth LE accessories' in xcode project capabilities
I have added a restoreStateIdentifier to BleModule.createClient()
I have matched optimizations with debug (and other configurations)

I have used these links for troubleshooting so far

https://blog.expo.dev/so-you-want-to-build-a-bluetooth-app-with-react-native-and-expo-6ea6a31a151d
https://github.com/innoveit/react-native-ble-manager/issues/273
https://stackoverflow.com/questions/72291956/why-is-testflight-app-different-from-local-development/72364266#72364266

Any ideas where else to look?

I eliminated the variable of my own application, and tried to build react-native-mcu-manager from this very repository in release mode.
Same results - no scan results, and this lovely warning below from CoreBluetooth.
Am I missing something in the documentation about releasing / deploying this?
Is nobody else using this in release mode?
2022-07-11 16:23:53.623062-0700 McuManagerExample[7610:1428601] [javascript] Running "McuManagerExample
2022-07-11 16:23:53.643137-0700 McuManagerExample[7610:1428594] [CoreBluetooth] API MISUSE: <CBCentralManager: 0x2801895f0> has no restore identifier but the delegate implements the centralManager:willRestoreState: method. Restoring will not be supported

Adding this wait got rid of the BleManager state error
https://github.com/dotintent/react-native-ble-plx/issues/715
Still not scanning but one step closer

Sorry @MikeSnyder360 - I've been away the last week.
Very interesting to see you've managed to get rid of the API MISUSE warning - we've been seeing that for ages although it seems to have been harmless.
We do use this in release mode without any problems.
If you are having scanning issues, I'm afraid that's a react-native-ble-plx issue.

let data = dataByteArray.withUnsafeBufferPointer { bufferPointer -> Data in
return Data(buffer: bufferPointer)
}
myPeripheral?.writeValue(data, for: firstWriteCharacteristic, type: .withResponse)
Remove the warning from the data object when creating data to be passed to the writeValue method.


I followed the manual for the installation, but it simply doesn't work. It has wasted several days of my time.

What is the issue?
I followed the manual for the installation, but it simply doesn't work. It has wasted several days of my time.
PTS-6795 informationAdditional information
No response

Hi, are you able to share any steps you followed? I will test the latest repo today, I'm sorry to hear this

Here's what I would recommend for troubleshooting:

Fork the repo.
Manually create a .env file; Populate the env file with your Cohere API key (the rest of the default values should work fine).
Run make dev

This is what I do to troubleshoot when the CLI isn't working.

I have tried setting up from a clean environment- I haven't been able to reproduce this issue. If you can share the errors you're running into we'd love to help.

Thank you. I have already resolved this issue now.


Enhancing "Configure" phase - Onboarding on Control Center

Is your feature request related to a problem? Please describe.
In this ticket, we are focused to enhancing the onboarding experience of Airy user on Control center.
The experience here is mainly focused on "Connectors details card" on "Connectors View" where user firstly arrives to configure an installed component.
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

We are no longer working on enhancing the UI.


fix: printing with inkmap decoupled from openlayers version

This solves the following issues:

When printing with the inkmap library, we need to respect its dependency to openlayers <=6.14. Therefore, instanceof checks had to be replaced to be less version dependent to allow parent projects to use higher ol-versions at the same time
When printing with the inkmap library, print will now succeed when some layers may be invisible / invalid instead of stopping the whole printout

@terrestris/devs please review

props @dnlkoch


Caused by: java.lang.NumberFormatException: For input string: "simple_response"

When i Send a message to API.AI server and client blink to error below :
java.lang.RuntimeException: An error occurred while executing doInBackground()
at android.os.AsyncTask$3.done(AsyncTask.java:325)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:354)
at java.util.concurrent.FutureTask.setException(FutureTask.java:223)
at java.util.concurrent.FutureTask.run(FutureTask.java:242)
at android.os.AsyncTask$SerialExecutor$1.run(AsyncTask.java:243)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1133)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:607)
at java.lang.Thread.run(Thread.java:761)
Caused by: java.lang.NumberFormatException: For input string: "simple_response"
at java.lang.Integer.parseInt(Integer.java:521)
at java.lang.Integer.parseInt(Integer.java:556)
at com.google.gson.JsonPrimitive.getAsInt(JsonPrimitive.java:260)
at ai.api.GsonFactory$ResponseItemAdapter.deserialize(GsonFactory.java:78)
at ai.api.GsonFactory$ResponseItemAdapter.deserialize(GsonFactory.java:71)
at com.google.gson.internal.bind.TreeTypeAdapter.read(TreeTypeAdapter.java:69)
at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:41)
at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:82)
at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:61)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)
at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)
at com.google.gson.Gson.fromJson(Gson.java:887)
at com.google.gson.Gson.fromJson(Gson.java:852)
at com.google.gson.Gson.fromJson(Gson.java:801)
at com.google.gson.Gson.fromJson(Gson.java:773)
at ai.api.AIDataService.request(AIDataService.java:193)
at ai.api.AIDataService.request(AIDataService.java:148)
at ai.api.AIDataService.request(AIDataService.java:124)
at ninhv.vl.vlchat.views.chat.ChatActivity$1.doInBackground(ChatActivity.java:90)
at ninhv.vl.vlchat.views.chat.ChatActivity$1.doInBackground(ChatActivity.java:85)
at android.os.AsyncTask$2.call(AsyncTask.java:305)
at java.util.concurrent.FutureTask.run(FutureTask.java:237)
at android.os.AsyncTask$SerialExecutor$1.run(AsyncTask.java:243)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1133)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:607)
at java.lang.Thread.run(Thread.java:761)
And here is code in doInBackground method
@Override
protected AIResponse doInBackground(AIRequest... requests) {
AIRequest request = requests[0];
try {
Log.e("REQUEST",request.toString());
return aiDataService.request(request);
} catch (AIServiceException e) {
}
return null;
}

My team encountered the exact same crash as of yesterday.
This problem appears to occur on Android when an agent uses an intent with a default text response (no webhook). We fixed it by using a webhook to fulfill all requests.

Same issue. wondering if someone knows the fix...

@johnflynn90 Same issue we are facing. Can you please share fix?

Same here

Hi @vishalkharat ,
We didn't really fix it. We avoided the crash by only using webhooks to generate responses to intents.
When creating an intent in API.AI you have the option to check "use webhook" instead of using text responses. My team found that the crash only occurs when we used the local API.AI text responses. We modified all of our intents to use webhooks so that our fulfillment server would generate text responses. I don't know why this works; we discovered it through trial and error.
If you don't have a fulfillment server (e.g. your agent lives entirely in API.AI) then this solution won't work for you.

@johnflynn90
This can be fixed by updating libai sdk. As api.ai is sending messages object in two formats as part of response. As follows:
"messages":[
{
"type":"simple_response",
"platform":"google",
"textToSpeech":"sample text to convert"
},
{
"type":0,
"speech":"sample text to convert"
}
]

Updating libai sdk how ? I am using the latest 1.4.8 in my build gradle , still this issue.
I think the issue lies in the onResult method
I may be wrong though

Hello friends!
Please no worries, we are working on problem!
Thank you for your patience

The issue was fixed in Java SDK and will be available on next release.

When is the next release coming for android because I am now frequently getting this issue in my android app. And if you can tell me any workaround please let me know.
Thanks

There is a kind of workaround. You may manually build and install Java SDK from GitHub repository:
git clone https://github.com/api-ai/apiai-java-client.git
cd apiai-java-client/
mvn install

This commands will checkout the code, build it and install library of version 1.4.9 into your local maven repository.
Next step is to change dependency version in your build.gradle file:
find line
compile 'ai.api:libai:1.4.8'

and replace it with
compile 'ai.api:libai:1.4.9'

rebuild your project.

Hi,
Thanks for the workaround, I did what you said and compiled the new
dependency and now when I am running the app its giving me two errors
1 Noclassdeffound error
2 ScriptManager error
Could you please tell me how to fix this.
Thanks
On Fri, Jun 23, 2017 at 3:35 PM, folomeev<EMAIL_ADDRESS>wrote:

There is a kind of workaround. You may manually build and install Java SDK
from GitHub repository:
git clone https://github.com/api-ai/apiai-java-client.gitcd apiai-java-client/
mvn install
This commands will checkout the code, build it and install library of
version 1.4.9 into your local maven repository.
Next step is to change dependency version in your build.gradle file:
find line
compile 'ai.api:libai:1.4.8'
and replace it with
compile 'ai.api:libai:1.4.9'
rebuild your project.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/api-ai/apiai-android-client/issues/43#issuecomment-310626832,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbKcR0IaHPEuKt2Zjtg9SwMdeSxSUVdLks5sG43mgaJpZM4NyU31
.

--
Siddhant Panhalkar
Senior Android Developer
Cosine Labs
https://cosinelabs.com/

I've build apiAISampleApp application and everything was fine.
Would you be so kind to provide the call stack traces?

When I am creating aidataservice object, its crashing on this below line.
When I use your these below dependency it doesn't crash
compile 'ai.api:libai:1.4.8'
compile 'ai.api:sdk:2.0.5@aar'
aiDataService = new AIDataService(this, config);
On Fri, Jun 23, 2017 at 6:40 PM, folomeev<EMAIL_ADDRESS>wrote:

I've build apiAISampleApp application and everything was fine.
Would you be so kind to provide the call stack traces?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/api-ai/apiai-android-client/issues/43#issuecomment-310661292,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbKcR354titVJLAy8l5r3CHsL2fM9-83ks5sG7lKgaJpZM4NyU31
.

--
Siddhant Panhalkar
Senior Android Developer
Cosine Labs
https://cosinelabs.com/

Hello everyone, i am still facing the same issue "Caused by: java.lang.NumberFormatException: Invalid int: "simple_response" " Before result the app crashes and i get that error on the console, see below the full error output:
AndroidRuntime: FATAL EXCEPTION: AsyncTask #1                                                                        Process: nl.nanomedia.virtuala, PID: 27568                                                                        java.lang.RuntimeException: An error occured while executing doInBackground()                                                                            at android.os.AsyncTask$3.done(AsyncTask.java:300)                                                                            at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:355)                                                                            at java.util.concurrent.FutureTask.setException(FutureTask.java:222)                                                                            at java.util.concurrent.FutureTask.run(FutureTask.java:242)                                                                            at android.os.AsyncTask$SerialExecutor$1.run(AsyncTask.java:231)                                                                            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1112)                                                                            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:587)                                                                            at java.lang.Thread.run(Thread.java:818)                                                                         Caused by: java.lang.NumberFormatException: Invalid int: "simple_response"                                                                            at java.lang.Integer.invalidInt(Integer.java:138)                                                                            at java.lang.Integer.parse(Integer.java:410)                                                                            at java.lang.Integer.parseInt(Integer.java:367)                                                                            at java.lang.Integer.parseInt(Integer.java:334)                                                                            at com.google.gson.JsonPrimitive.getAsInt(JsonPrimitive.java:260)                                                                            at ai.api.GsonFactory$ResponseItemAdapter.deserialize(GsonFactory.java:78)                                                                            at ai.api.GsonFactory$ResponseItemAdapter.deserialize(GsonFactory.java:71)                                                                            at com.google.gson.internal.bind.TreeTypeAdapter.read(TreeTypeAdapter.java:69)                                                                            at com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:41)                                                                            at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:82)                                                                            at com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:61)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:129)                                                                            at com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:220)                                                                            at com.google.gson.Gson.fromJson(Gson.java:887)                                                                            at com.google.gson.Gson.fromJson(Gson.java:852)                                                                            at com.google.gson.Gson.fromJson(Gson.java:801)                                                                            at com.google.gson.Gson.fromJson(Gson.java:773)                                                                            at ai.api.AIDataService.request(AIDataService.java:193)                                                                            at ai.api.AIDataService.request(AIDataService.java:148)                                                                            at ai.api.services.GoogleRecognitionServiceImpl$2.doInBackground(GoogleRecognitionServiceImpl.java:166)                                                                            at ai.api.services.GoogleRecognitionServiceImpl$2.doInBackground(GoogleRecognitionServiceImpl.java:158)                                                                            at android.os.AsyncTask$2.call(AsyncTask.java:288)

This error came back about 2 or 3 days. But this bug had disappeared for about 2 weeks before that.

Fixed.
Please update dependency version up to 2.0.6:
compile 'ai.api:sdk:2.0.6@aar'

I updated the dependency again setting the custom session id in AIRequest
object, than also its not happening.
AIRequest request = new AIRequest();
request.setSessionId(MyData.getInstance(MyApplication.getInstance()).getGatewayId()

"_" +
MyData.getInstance(MyApplication.getInstance()).getUsername());
request.setQuery(message);

Please let me know any fix or workaround because I need to make it
work as soon as possible.
Thank you
On Sat, Jul 8, 2017 at 9:52 AM, folomeev<EMAIL_ADDRESS>wrote:

Closed #43 https://github.com/api-ai/apiai-android-client/issues/43.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/api-ai/apiai-android-client/issues/43#event-1155387202,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AbKcRzDM5K08y44h76M04NHmAXNld_6nks5sLwQCgaJpZM4NyU31
.

--
Siddhant Panhalkar
Senior Android Developer
Cosine Labs
https://cosinelabs.com/

Hello everyone, i facing  error " Caused by: java.lang.NumberFormatException:For input string: "Rabbi"".
Before the app crashes i get the following error:
2018-03-31 20:42:53.448 32009-32066/com.example.diu.pointofsale E/AndroidRuntime: FATAL EXCEPTION: AsyncTask #3
Process: com.example.diu.pointofsale, PID: 32009
java.lang.RuntimeException: An error occurred while executing doInBackground()
at android.os.AsyncTask$3.done(AsyncTask.java:318)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:354)
at java.util.concurrent.FutureTask.setException(FutureTask.java:223)
at java.util.concurrent.FutureTask.run(FutureTask.java:242)
at android.os.AsyncTask$SerialExecutor$1.run(AsyncTask.java:243)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1133)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:607)
at java.lang.Thread.run(Thread.java:761)
Caused by: java.lang.NumberFormatException: For input string: "Rabbi"
at java.lang.Integer.parseInt(Integer.java:521)
at java.lang.Integer.parseInt(Integer.java:556)
at com.example.diu.pointofsale.Database.DatabaseHelper.getAllUser(DatabaseHelper.java:267)
at com.example.diu.pointofsale.Activity.AdminHomeActivity$2.doInBackground(AdminHomeActivity.java:108)
at com.example.diu.pointofsale.Activity.AdminHomeActivity$2.doInBackground(AdminHomeActivity.java:104)
at android.os.AsyncTask$2.call(AsyncTask.java:304)
at java.util.concurrent.FutureTask.run(FutureTask.java:237)
at android.os.AsyncTask$SerialExecutor$1.run(AsyncTask.java:243)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1133)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:607)
at java.lang.Thread.run(Thread.java:761)
Please help me how to fix it..


[java] Apply native plugins when profiling and tracing is disabled

Motivation
The build for the native application is broken when the with-profiling and without-profiling profiles are both disabled. They are both disabled when trying to run the native app without any instrumentation.
Changes
spring-boot-maven-plugin and native-maven-plugin are defined in <pluginManagement> in spring-boot-parent. To activate them, they have to be defined in <plugins>. This PR always applies the plugins then uses the two profiles to change the build args.
Workflow

⚠ Create your PR as draft ⚠
Work on you PR until the CI passes (if something not related to your task is failing, you can ignore it)
Mark it as ready for review

Test logic is modified? -> Get a review from RFC owner. We're working on refining the codeowners file quickly.
Framework is modified, or non obvious usage of it -> get a review from R&P team

:rocket: Once your PR is reviewed, you can merge it!
🛟 #apm-shared-testing 🛟
Reviewer checklist

[ ] If PR title starts with [<language>], double-check that only <language> is impacted by the change
[ ] No system-tests internal is modified. Otherwise, I have the approval from R&P team
[ ] CI is green, or failing jobs are not related to this change (and you are 100% sure about this statement)
[ ] A docker base image is modified?

[ ] the relevant build-XXX-image label is present

[ ] A scenario is added (or removed)?

[ ] Get a review from R&P team

I let the java team have an educated eye on this one.


Add contextual parsing support for GoLang?

I thought it was a bug at first.
However, I realized that I was seeing the contextualParsing description.
Can you also support the Go language?

Sorry for the wait, should be added now


added trouble shooting build hints

After several request for help on our issues, I compiled a couple of hits on how to build/rebuild onnx-mlir. Hopefully it will be helpful to others and reduce the traffic of issues on this matter.
Signed-off-by: Alexandre Eichenberger<EMAIL_ADDRESS>

Jenkins Linux amd64 Build #5432 [push] added trouble shooting b... started at 20:32

Jenkins Linux ppc64le Build #4570 [push] added trouble shooting b... started at 21:37

Jenkins Linux s390x Build #5449 [push] added trouble shooting b... started at 21:33

Jenkins Linux s390x Build #5449 [push] added trouble shooting b... passed after 1 hr 0 min

Jenkins Linux ppc64le Build #4570 [push] added trouble shooting b... passed after 1 hr 6 min

Jenkins Linux amd64 Build #5432 [push] added trouble shooting b... passed after 1 hr 16 min


Peer-To-Peer community edition networking

Server should be able to (By Version 1.0.0) connect in a mesh and allow peer-to-peer replication between regions. This should allow for low complexity highly scalable game server deployments.

We are in progress on a Horizon Core rewrite that refs this issue. completing that and merging it will allow us to complete work on the Horizon link plugin for community edition networking. This will be left open for the time being and worked on further after we merge the PR.
PR: #182

The core rewrite (As you may well have noticed) is complete. This too we hope to complete by the 24th of November.

@haywoodspartan I could use a hand on the master server stuff if you are free. We can keep it simple for now. Let me know when you have some time to sit down for a couple hours and take a crack at it.

#202 Will put us much closer to having this system complete it will be merged before the 0.13.0 release, which will allow us to continue this after we make that release in working towards 1.0.0.
After 1.0.0 we will enter the engine backend phase where backends are developed alongside template projects for each major engine starting with UE5.


[cloud_firestore] Fix stream error report on iOS

Description
Fixes #185.
On iOS, there were no reports about stream error.
For "Query#addSnapshotListener" and "DocumentReference#addSnapshotListener", error should be sent by calling [weakSelf.channel invokeMethod:], not result().
Calling result() doesn't make sense for this case.
On Android, it also doesn't send error, but System.out.println(e) is called instead:

https://github.com/FirebaseExtended/flutterfire/blob/bdb95fcacf7cf077d162d2f267eee54a8b0be3bc/packages/cloud_firestore/cloud_firestore/android/src/main/java/io/flutter/plugins/firebase/cloudfirestore/CloudFirestorePlugin.java#L407-L408
https://github.com/FirebaseExtended/flutterfire/blob/bdb95fcacf7cf077d162d2f267eee54a8b0be3bc/packages/cloud_firestore/cloud_firestore/android/src/main/java/io/flutter/plugins/firebase/cloudfirestore/CloudFirestorePlugin.java#L438-L439

iOS's behavior should follow this.
And, It is very useful to know what error was occurred and how to fix it from the error log.
Typical error for this is index error like this, so printing the error is enough in most cases.

W/Firestore(23867): (21.3.0) [Firestore]: Listen for Query(tests where foo == bar order by -foo2, -name) failed: Status{code=FAILED_PRECONDITION, description=The query requires an index. You can create it here: https://console.firebase.google.com/v1/r/project/xxxxxxxx/firestore/indexes?create_composite=xxxxxxxxxxxxxxxxx, cause=null}

Of course, it is better to send error to dart side, so // TODO: send error is reasonable.
Related Issues
#185, as mentioned above.
Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]). This will ensure a smooth and quick review process.

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] If the pull request affects only one plugin, the PR title starts with the name of the plugin in brackets (e.g. [cloud_firestore])
[ ] My PR includes unit or integration tests for all changed/updated/fixed behaviors (See Contributor Guide).

It is hard to write test about this, and exiting Android implementation have no tests about this.

[x] All existing and new tests are passing.
[ ] I updated/added relevant documentation (doc comments with ///).
[x] The analyzer (flutter analyze) does not report any problems on my PR.
[x] I read and followed the Flutter Style Guide.
[x] I updated pubspec.yaml with an appropriate new version according to the pub versioning philosophy.
[x] I updated CHANGELOG.md to add a description of the change.
[x] I signed the CLA.
[x] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require plugin users to manually update their apps to accommodate your change?
I cannot determin whether this is breaking change or not, but I think "no" because calling result() didn't make sense and NSLog was just added.

[ ] Yes, this is a breaking change (please indicate a breaking change in CHANGELOG.md and increment major revision).
[x] No, this is not a breaking change.

Why no response?

@collinjackson
Could you check this, please?

Hey @mono0926 - really appreciate you contributing and sending up this PR, thank you. We've already fixed this in our rework PR (#2913) which has now been merged, so I'm going to go ahead and close this PR as it's no longer required. Please don't hesitate to contribute again in future though :)


Testing architecture.

Adds a RFC proposing how the Kubewarden project should organize and run their tests.
Please, let me know if you miss some information in the RFC.

I've updated the RFC with some nice comments from @kravciak

@ereslibre  and @flavio , I've asked for your review again because I've added a suggestion of an interface to allow running the end to end test from other repositories, like controller and policy-server.


Reset styles after writing output. Fix defparam/smuggler#2

Thanks David!
This was a result of not actually testing this script on MacOS. Thanks for catching this and the patch.
Best,
@defparam


Add option to set initial search and delete delay values

Fixes #128 and #118

This change is

From testing 1000ms seems like a good delay. For me the API has not complained yet with 1000ms set for both. Perhaps you could change the default delay to 1000ms instead.

After a bit more careful testing, search delay does not seem nearly as impactful as delete delay. Documentation and code has been updated accordingly.

Just tested this for hours and it works perfectly. Also a delete delay value of 800ms works fine without triggering any rate-limits. Hoping this PR gets merged.

@victornpb requesting review


fix(transformer/class-properties): stop searching for super() in TSModuleBlocks

Fix edge case in class static properties transform. When transforming super() in class constructor, stop searching when hit a TSModuleBlock. TSModuleBlock is essentially a function, so super() there is invalid.

#7481
#7480  👈 (View in Graphite)
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

I think I know this transform better than anyone else at present, so merging without review to avoid wasting anyone else's time.


ISPN-16068 CLI Rest Client isn't properly encoding backup and restore…

https://issues.redhat.com/browse/ISPN-16068
@tristantarrant I have moved the sanitise method to a generic Util class as it's not specific to RestCacheClientJDK.

Merged, thanks


adding php 8.3 dev image

adds 8.3 local builds, and also github build of our debug/dev image

this is fine to merge now, since it builds from source (not dependent on official docker images etc)


Installation error

When I have following in my composer.json
{
	"name": "foo/bar",
	"description": "",
	"require": {},
	"require-dev": {
		"roave/security-advisories": "dev-latest",
		"symplify/config-transformer": "v9.3.25",
		"symplify/easy-coding-standard": "9.3.25"
	},
	"config": {
		"platform": {
			"php": "8.0.0"
		},
		"preferred-install": {
			"*": "dist"
		},
		"sort-packages": true
	}
}

I'm getting following error;
Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - symplify/easy-testing v9.3.25 requires symplify/console-package-builder ^9.3.25 -> found symplify/console-package-builder[dev-main, 9.4.x-dev (alias of dev-main)] but it does not match your minimum-stability.
    - symplify/php-config-printer v9.3.25 requires symplify/symplify-kernel ^9.3.25 -> satisfiable by symplify/symplify-kernel[v9.3.25].
    - symplify/symplify-kernel v9.3.25 requires symplify/package-builder ^9.3.25 -> satisfiable by symplify/package-builder[v9.3.25].
    - symplify/config-transformer v9.3.25 requires symplify/php-config-printer ^9.3.25 -> satisfiable by symplify/php-config-printer[v9.3.25].
    - symplify/package-builder v9.3.25 requires symplify/easy-testing ^9.3.25 -> satisfiable by symplify/easy-testing[v9.3.25].
    - Root composer.json requires symplify/config-transformer v9.3.25 -> satisfiable by symplify/config-transformer[v9.3.25].

Hi, thanks for reporting. I have same problems, as packagist does not load new tags since 9.3.23. I tried update packages manually in packagis administration, but it's broken too.

Could you re-try in an hour? It might be fixed now

@TomasVotruba Looks like 9.3.26 version solved this error.


<EMAIL_ADDRESS>Branch install fails

The latest cordova-android release has completely changed the structure of the platform folder. This causes the branch script to fail.
To remedy this (and remain backwards compatible) one could add the following on line 16 (between var pathToManifest and var manifest):
    if (!fs.exists(pathToManifest)) {
        pathToManifest = path.join(context.opts.projectRoot, 'platforms', 'android', 'app', 'src', 'main', 'AndroidManifest.xml')
    }

This should enable the Branch cordova sdk to be used with cordova-android@7+ without breaking older versions.

Hello,
Thank you for reaching out.
Can you please elaborate on how you are getting the path platforms/android/app/src/main/AndroidManifest.xml?
With the following commands:
npm -g i cordova
cordova create example
cd example
cordova platform add android

This is where the AndroidManifest.xml is located in your project:
├── config.xml
├── hooks
├── node_modules
├── package-lock.json
├── package.json
├── platforms
│   ├── android
│   │   ├── AndroidManifest.xml
├── plugins
├── res
└── www

Thanks,

If using cordova-android@latest (7.0.0+) this is no longer the structure, please check against 7.0.0

Fixed in #407
I would recommend updating to the latest version 2.6.21. You can use this guide to update your Cordova Branch SDK.
Thanks,


$http .success method removed in angular v1.6.0, use .then method instead.

Deprecation Notice
The $http legacy promise methods .success and .error have been deprecated and will be removed in v1.6.0. Use the standard .then method
instead.

Thanks, this works great!

@m00s, please merge this

@m00s Any plans to release a new version on npm containing this fix?

Hello, I'm also needing this fix to be merged. @m00s  Do you know when is this going to be published?
Thanks


issue when using LV_SYMBOL in lv_imgbtn

Important: issues that don't use this template will be ignored/closed.

Describe the bug
Can't seem to use LV_SYMBOL derived lv_imgs in lv_imgbtn
It seems that the imgbtn renderer interprets the strings as filesystem paths even when using lv_img as an intermediary step.
To Reproduce
lv_obj_t * img_rear_beep_mute = lv_img_create(actions_container, NULL);
lv_img_set_src(img_rear_beep_mute, LV_SYMBOL_MUTE "");
lv_obj_t * img_rear_beep_max = lv_img_create(actions_container, NULL);
	lv_img_set_src(img_rear_beep_max, LV_SYMBOL_DUMMY LV_SYMBOL_VOLUME_MAX "Beep");

lv_imgbtn_set_src(img_btn_rear_beep, LV_BTN_STATE_REL , LV_SYMBOL_DUMMY LV_SYMBOL_VOLUME_MAX "Beep");
lv_imgbtn_set_src(img_btn_rear_beep,LV_BTN_STATE_PR , &img_rear_beep_max);
lv_imgbtn_set_src(img_btn_rear_beep, LV_BTN_STATE_TGL_PR, &img_rear_beep_max);
lv_imgbtn_set_src(img_btn_rear_beep, LV_BTN_STATE_TGL_REL, &img_rear_beep_mute);
lv_imgbtn_set_src(img_btn_rear_beep, LV_BTN_STATE_INA, &img_rear_beep_mute);

Expected behavior
I was hoping to be able to leverage the state derived image configurations available from lv_imgbtn, but using font symbol derived lv_imgs as source.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

Technically, this belongs on the forum. But I'll let it go this time. :smiley:
Did you read this? https://docs.littlevgl.com/en/html/object-types/img.html#image-source
The same information applies to lv_imgbtn.
So something like this should work (not tested):
lv_imgbtn_set_src(img_btn_rear_beep, LV_BTN_STATE_PR, LV_SYMBOL_VOLUME_MAX);

Passing an image object as the source parameter in lv_imgbtn_set_src is not supported as far as I know.

Actually lv_imgbtn doesn't support "Symbols" as image source. :slightly_frowning_face:

@kisvegabor We should add that to the documentation. Unless it's already there and I didn't see it?

It's really not documented now.
I've updated it: https://github.com/littlevgl/docs/commit/6bf373342f39c5b68e683756c720c4972e7407c0

Thanks for adding it to the documentation, it did indeed imply that the imgbtn src behavior was the same as img - frankly I wish it was, this would allow for very easily having different Symbol icons for different LV_BTN_STATEs. I humbly suggest adding this in future releases as the boiler plate involved currently for this kind of behavior seems a bit excessive ( not to mention that it seems that it actually has to happen in event handlers and involves lv_set_label_text ).

I've looked into in and added symbol support in dev-6.1.
However, it works only in non-tiled mode (LV_IMGBTN_TILED 0)

    lv_obj_t * ib = lv_imgbtn_create(lv_scr_act(), NULL);
    lv_imgbtn_set_src(ib, LV_BTN_STATE_REL, LV_SYMBOL_EYE_OPEN);
    lv_imgbtn_set_src(ib, LV_BTN_STATE_PR, LV_SYMBOL_EYE_CLOSE);
    lv_imgbtn_set_style(ib, LV_BTN_STYLE_REL, &lv_style_plain);

I'm not perfectly happy with the API now because once you enable tiled mode you lose the symbol support. But a correct fix would require API change. So it's another story for v7.0.

Thank you!


Add specs for electric guitar

Please accept my pull request :)

My bad, i now understand what to do. I just have a question, shouldn't I put the file in ...\Lab00App-build\Lab00App-tests\src\test\java\ch\heigvd\res\lab00 path?


example code and possible upgrades

I think something like this would be much better in the readme file:
tests/calculator.specs
feature('Calculator: add')
    .scenario('should be able to add 2 numbers together')
        .when('I enter "1"')
        .and('I add "2"')
        .then('I should get "3"')
    .scenario('should be able to add 3 numbers together')
        .when('I enter "1"')
        .and('I add "2"')
        .and('I add "3"')
        .then('I should get "6"')

tests/calculator.steps
featureSteps('Calculator:')
    .before(function(){
        this.values = [];
        this.total = null;
    })
    .when('I enter "(.*)"', function(value){
        this.values.push(Number(value));
    })
    .when('I add "(.*)"', function(value){
        this.values.push(Number(value));
    })
    .then('I should get "(.*)"', function(expectedTotal){
	    this.total = add.apply(null, this.values);
        expect(this.total).toBe(Number(expectedTotal));
    });

calculator.js
function add(){
	var args = Array.prototype.slice.call(arguments);
	var total = 0;
	for (var i in args)
		total += args[i];
	return total;
}

You put the implementation of the code you want to test into the steps file. It is better to decouple it by defining a function. Btw. this part is reusable:
        .when('I enter "(.*)"', function(value){
            this.values.push(Number(value));
        })
        .when('I add "(.*)"', function(value){
            this.values.push(Number(value));
        })

Is it possible to reuse it somehow?
Another possible upgrade is auto-conversion of \d into numbers. Maybe it would be better to use a schema language like mongoose schema instead of trying to parse the regex for that info, but I guess that would be overengineering.

cucumber.js has a transform keyword, which can do the auto-conversion. I think I'll create my own repo based on this and cucumber.

Thanks for the input, send me a link to the repo once you get it going, I would love to have a look


Update readmes to match common design (Scene category) 3/5

Thanks @Rachael-E , that was already done, I just forgot to mark as resolved 😄


Remove: AltDrag.AltDrag version 1.1

Moved to AltSnap.AltSnap

[X] Have you signed the Contributor License Agreement?
[ ] Have you checked that there aren't other open pull requests for the same manifest update/change?

[ ] Have you tested your manifest locally with winget install --manifest <path>?
[ ] Does your manifest conform to the 1.0 schema?

Microsoft Reviewers: Open in CodeFlow

wut, not the same package


"Invalid Mapping" from ember-cli-uglify on build

Getting this error on minify from ember-cli-uglify on build...
File: assets/vendor.js
Invalid mapping: {"generated":{"line":111536,"column":-5},"source":"vendor/whatwg-fetch/fetch.js","original":{"line":1,"column":0},"name":null}
Error: Invalid mapping: {"generated":{"line":111536,"column":-5},"source":"vendor/whatwg-fetch/fetch.js","original":{"line":1,"column":0},"name":null}
    at SourceMapGenerator_validateMapping [as _validateMapping] (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/node_modules/source-map/lib/source-map/source-map-generator.js:272:15)
    at SourceMapGenerator_addMapping [as addMapping] (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/node_modules/source-map/lib/source-map/source-map-generator.js:102:12)
    at /Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/node_modules/source-map/lib/source-map/source-map-generator.js:74:19
    at Array.forEach (native)
    at SourceMapConsumer_eachMapping [as eachMapping] (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/node_modules/source-map/lib/source-map/source-map-consumer.js:473:10)
    at Function.SourceMapGenerator_fromSourceMap [as fromSourceMap] (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/node_modules/source-map/lib/source-map/source-map-generator.js:50:26)
    at Context.SourceMap (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/lib/sourcemap.js:59:52)
    at Object.exports.minify (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/node_modules/uglify-js/tools/node.js:111:38)
    at UglifyWriter.processFile (/Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/index.js:99:27)
    at /Users/chrism/myapp/node_modules/ember-cli-uglify/node_modules/broccoli-uglify-sourcemap/index.js:46:14

This may be an issue in the actual github-fetch polyfill ?
Ember CLI v1.13.7
Ember v1.13.10

I apologize, I found this issue elsewhere, it is related to ember-cli-uglify. Closing this issue.
https://github.com/ember-cli/ember-cli-uglify/issues/4


Missing extraction formats in python tooling

The packaging documentation says that .tar.xz and tar.bz are supported, but the new python tooling does not support these two formats. In addition, it does not check the return value of auto_extract to catch unsupported formats.

Thanks for the report @jonahweissman. Opened #260 to fix this.

Thanks for the report @jonahweissman. Opened #260 to fix this.


add config tornado_debug to allow running tornado in debug mode

Here's a pull request for  issue #393 that I just created.
I added a config attribute to set tornado debug mode.
I tried some test scripts for this, but it was a little tricky reloading the app without reloading the test.

This sounds like it can be useful. Since all this does is pass an argument to Tornado, and is a feature only used by specific users (devs), let's assume that Tornado tested this feature and "manually test" whether it works with Flexx.

Travis seems to be a bit glitchy lately, but it turned green after rerunning.

Is this ready from your end?

Yes
On Aug 23, 2017 05:33, "Almar Klein"<EMAIL_ADDRESS>wrote:
Is this ready from your end?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/zoofIO/flexx/pull/394#issuecomment-324289675, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABBlN1wdK12TwZ-bENNRsTIiyTh-vagFks5sbAAAgaJpZM4O8c9d
.

Thanks!


when NETWORK=testnet docker-compose up, I think it has different genesis.json

here is my docker-compose.yaml
version: "3.5"

services:
  postgres:
    image: postgres:11.5-alpine
    container_name: postgres
    hostname: postgres
    environment:
      - POSTGRES_LOGGING=true
      - POSTGRES_DB_FILE=/run/secrets/postgres_db
      - POSTGRES_PASSWORD_FILE=/run/secrets/postgres_password
      - POSTGRES_USER_FILE=/run/secrets/postgres_user
    secrets:
      - postgres_password
      - postgres_user
      - postgres_db
    volumes:
      - postgres:/var/lib/postgresql/data
    ports:
      - 5432:5432
    restart: on-failure
    logging:
      driver: "json-file"
      options:
        max-size: "400k"
        max-file: "20"

  cardano-node:
    image: inputoutput/cardano-node:${CARDANO_NODE_VERSION:-1.18.0}
    environment:
      - NETWORK=${NETWORK:-mainnet}
    volumes:
      - node-db:/data/db
      - node-ipc:/ipc
    logging:
      driver: "json-file"
      options:
        max-size: "200k"
        max-file: "10"

  cardano-db-sync:
    image: inputoutput/cardano-db-sync:${CARDANO_DB_SYNC_VERSION:-3.0.0}
    environment:
      - NETWORK=${NETWORK:-mainnet}
      - POSTGRES_HOST=postgres
      - POSTGRES_PORT=5432
    depends_on:
      - cardano-node
      - postgres
    secrets:
      - postgres_password
      - postgres_user
      - postgres_db
    volumes:
      - node-ipc:/node-ipc
    restart: on-failure
    logging:
      driver: "json-file"
      options:
        max-size: "200k"
        max-file: "10"

  cardano-submit-api:
    image: inputoutput/cardano-submit-api:${CARDANO_SUBMIT_API_VERSION:-2.1.0}
    environment:
      - NETWORK=${NETWORK:-mainnet}
    depends_on:
      - cardano-node
    volumes:
      - node-ipc:/node-ipc
    ports:
      - 8101:8101
    restart: on-failure
    logging:
      driver: "json-file"
      options:
        max-size: "200k"
        max-file: "10"

secrets:
  postgres_db:
    file: ./config/postgres_db
  postgres_password:
    file: ./config/postgres_password
  postgres_user:
    file: ./config/postgres_user

volumes:
  postgres:
  node-db:
  node-ipc:

cardano-node version is 1.18.0 and   cardano-db-sync version is 3.0.0
I think it's default testnet genesis.json file is different from cardano-node's
NETWORK=testnet docker-compose up

after this i got error
cardano-db-sync_1     | With Cardano protocol, Byron/Shelley config mismatch:
cardano-db-sync_1     |    SystemStart 2019-07-24 20:20:16 UTC /= 2019-07-22 20:20:16 UTC

How can i  find solution?

@sjlee1125 I had the same issue, think it will be faster if I change the config and create my own docker image.

IOHK deployed the update proposal to Byron testnet. The Shelley hard fork has been endorsed on testnet and will occur in 5 hours' time. What is the reason for connecting to testnet? What component are you trying to test?

the 3.1.0 tag has the newer genesis


Gulp-install fails silently with more than 16 package.json files

I am working on a Serverless project that has lots of separately deployable components. Each of these components has their own package.json file. I created a gulp task that uses gulp-install to install dependencies for all of the modules in one go. However this only worked until we reached the magic limit of 17 package.json files. When this happens gulp-install will stop installing packages but will not produce any error message to indicate that something went wrong.

I believe the problem is somehow related to the _high water mark_ of 16 items in Node streams.

I created an example project for testing. See https://github.com/cyberixae/gulp-install-test

@cyberixae it is related to high water mark of 16 , gulp-install uses through2 #L30 in object-mode which sets the hwm to 16 for the default.. the reason you cannot process more than 17 files is because you are adding files readable part of through2 module and its hitting the buffer limit. based on your test repo you need to drain the readable part by doing something like pipe(install()).pipe(...) then you can process more than aforementioned file limit

Actually, we ended up using the Serverless AutoInstall Plugin, so this bug thread is no longer relevant for me. The plugin can be found at https://github.com/kennu/serverless-plugin-autoinstall if someone else has the same use case.

Hi, I think i am facing the same issue here, the problem is that I am not using Serverless so I cannot avoid the problem so easily, surprisingly for me, If i use gulp-install 0.4.0 it works like a charm...

Sorry for the great delay!
A fix for this is on its way...


Several text rendering issues

SVG Test TextAlign.svg.txt

ink
resvg
rsvg

mistakes

Try text on path below (right upper corner)
text-anchor=" for left-to-right-text
Chinese(whatsoever) verticallyc written is too high

source: https://commons.wikimedia.org/wiki/File:SVG_Test_TextAlign.svg
author Glrx
license: https://creativecommons.org/licenses/by-sa/3.0/deed.de

Try text on path below (right upper corner)

What is wrong with it?

text-anchor=" for left-to-right-text

This is an undefined behavior. We can do whatever we want.

Chinese(whatsoever) verticallyc written is too high

dominant-baseline isn't supported. #119

What is wrong with it?

dominant-baseline="central" (ok thats #119 )

Chinese(whatsoever) verticallyc written is too high

in line 95 I do not see any dominant-baseline

lib
pic

resvg

svg

alignment-baseline isn't supported also. I've created #242


Fixes #654 Verses dropdown

Fixes #654
Fixes #648

Deployed to: http://staging.quran.com:32789

Deployed to: http://staging.quran.com:32791

Deployed to: http://staging.quran.com:32793

Deployed to: http://staging.quran.com:32802

Deployed to: http://staging.quran.com:32804


IMPROVING NAVBAR UI

the website Navbar is  to scaled for ui perspective . so can i improve it and some minors ui improvement

@Ayusht777  Sure, assigned the issue, you can start working on it.

hey can i use react icons library in it , also can i change the logo of this website

hey can i use react icons library in it , also can i change the logo of this website

Sure, you can use react-icons and change logo if needed. Do share the screenshot of the new navbar.

hey this new improve navbar and if you want improve something in it than tell me

hi i am getting this error creating the pull request
Someone is attempting to deploy a commit to a Personal Account owned by @suryanshsingh2001 on Vercel.
@suryanshsingh2001 first needs to authorize it.


point clouds with various size

Hi Erik,
is it possible to use point clouds with various size? I am struggling to understand if the sampling and grouping step allows me to do that.
Thanks

What do you mean by various sizes?  If you mean various numbers of points, then yes (although you'll need to pad/duplicate points for batching).
If you mean various spatial sizes, also yes, but you mean need to change the sizes of the ball queries in the grouping stages to get good performance.

thanks for replying so quickly. I have different numbers of points in each
point cloud ranging between 500 and 120k. Do you mean i should decide on a
fixed size input (lets say 10k) and then pad/duplicate or downsample my
whole data set to 10k?
On Mon, 27 May 2019 at 21:39, Erik Wijmans<EMAIL_ADDRESS>wrote:

What do you mean by various sizes? If you mean various numbers of points,
then yes (although you'll need to pad/duplicate points for batching).
If you mean various spatial sizes, also yes, but you mean need to change
the sizes of the ball queries in the grouping stages to get good
performance.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/erikwijmans/Pointnet2_PyTorch/issues/50?email_source=notifications&email_token=AENNRZMOLMGFWBZ2YJBF3XTPXQ2HXA5CNFSM4HP5XOQKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODWKNF7I#issuecomment-496292605,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AENNRZKYSIQCIAIKFJZM5GLPXQ2HXANCNFSM4HP5XOQA
.


Change accidental "Docker for Azure" leftover

Proposed changes

Unreleased project version (optional)

Related issues (optional)

LGTM  cc @mstanleyjones @johndmulhausen

Thanks @jakobfaerch :)


Docs/improved setup and updated colors

This PR adds some minor improvements to our documentation:
Specifically:

Added brand identity colors
Improved the Getting started page in docs

LGTM :shipit:


Prevent form clear on Server error

Spending a long time to type out a message on mobile and then not save it would be rather frustrating. Definitely fix before next deploy!!!

Removed the following from the contact_me.js file on the error condition:
$('#contactForm').trigger("reset");


Refactor DataFusionInstanceLink usage

Refactored DataFusionPipelineLinkHelper into a more generic function

This PR contains some refactoring required for Data Fusion system fix. It doesn't contain the @GoogleBaseHook.fallback_to_default_project_id usage because we can use it only within a hook. But in this case it is needed in operators' methods. That's why I'm extracting project_id from the instance name with the refactored helper function.


ci(workflow): enable community contributions

Description

This PR enables community contributions, by dropping ghcr uploads on pull requests, and instead uses artifacts.
If there is a release ghcr.io will be used, no change was made there.
In case of pull requests, artifacts are created and used for e2e testing.
No comments will be posted under PR's with the images, instead the build artifacts can be used for further manual testing.
Minor design changes.

Type of Change

[ ] Bug Fix
[X] New Feature
[ ] Breaking Change
[ ] Refactor
[ ] Documentation
[ ] Other (please describe)

Checklist

[x] I have read the contributing guidelines
[x] Existing issues have been referenced (where applicable)
[x] I have verified this change is not present in other open pull requests
[ ] Functionality is documented
[x] All code style checks pass
[ ] New code contribution is covered by automated tests
[x] All new and existing tests pass

What will happen if we want to wire in the cloud e2e tests? Will we have the latest tagged images on the main branch? If I see it correctly then we build and push to ghcr images only when creating a release.

No comments will be posted under PR's with the images, instead the build artifacts can be used for further manual testing.

How can I use the build artifacts for manual testing? For example if I want to deploy the whole system on AWS and test my changes there, how do I overwrite the images in the cloudformation file?
I guess we have to build the images locally, upload them to DockerHub and use those in the cloudformation file. I have no objections against it, if the others agree that it's a good trade off for enabling the members to contribute.

@adamtagscherer

What will happen if we want to wire in the cloud e2e tests? Will we have the latest tagged images on the main branch? If I see it correctly then we build and push to ghcr images only when creating a release.

We are building images when we are pushing to main, check main-merge.yml, those images will be tagged latest, and can be used for the e2e tests for the different environments.

No comments will be posted under PR's with the images, instead the build artifacts can be used for further manual testing.

How can I use the build artifacts for manual testing? For example if I want to deploy the whole system on AWS and test my changes there, how do I overwrite the images in the cloudformation file?
I guess we have to build the images locally, upload them to DockerHub and use those in the cloudformation file. I have no objections against it, if the others agree that it's a good trade off for enabling the members to contribute.

We can create a workflow that can be ran manually by org members, to upload images to ghcr tagged with dev, so it can be used for such use-cases you mentioned.
The artifacts themselves can be found on the actions page if you scroll down. The workflow creates docker images, that can be loaded to your own local docker registry or any with docker load {image}.

What will happen if we want to wire in the cloud e2e tests? Will we have the latest tagged images on the main branch? If I see it correctly then we build and push to ghcr images only when creating a release.

No comments will be posted under PR's with the images, instead the build artifacts can be used for further manual testing.

How can I use the build artifacts for manual testing? For example if I want to deploy the whole system on AWS and test my changes there, how do I overwrite the images in the cloudformation file?
I guess we have to build the images locally, upload them to DockerHub and use those in the cloudformation file. I have no objections against it, if the others agree that it's a good trade off for enabling the members to contribute.

@adamtagscherer raises important concerns and i would also like to add to this. Although we are not pushing PR images to GHCR, we could solve this by creating another (manually triggered) workflow that takes specific PR commit reference and pushes built artifacts for that commit to GHCR. This would allow us to test things, would also unblock community contributions, and it would also address the security concerns. My suggestion is that we add this action in a separate PR after this one is merged (it can be reused similarly to pushes to main).
I wrote a small PoC bash script that can import images from a specific GA pipeline run into local docker registry. I have tested it against GA run https://github.com/openclarity/vmclarity/actions/runs/9664752735. You need GitHub CLI to run this. Note that pulling artifacts can take some time. It can be used in case we use docker-only approach for E2E testing on cloud providers. It does not solve directly the second concern regarding CF file (unless it is extended with this script). But the suggestion above
#!/usr/bin/env bash

## Defines which image artifacts to download
GH_ACTION_RUN_ID="9660640440"
PLATFORM="arm64"

## Defines how to tag loaded VMClarity images
IMPORTED_IMAGE_REGISTRY="ghcr.io/openclarity"
IMPORTED_IMAGE_TAG="latest"

## Set path to temporary dir where artifacts will be pulled into
mkdir -p /tmp/vmclarity-images
cd  /tmp/vmclarity-images

## Download all artifacts using GitHub CLI
gh run download --repo openclarity/vmclarity ${GH_ACTIONS_RUN_ID}

## Load all VMClarity platform-specific images
for image_archive in vmclarity-*-${PLATFORM}/*.tar; do
  # load image
  image_name=$(basename $image_archive .tar)
  image_load_output=$(docker load --input "$image_archive" --quiet)
  image_id=${image_load_output#"Loaded image ID: sha256:"} # strip prefix, very hacky due to https://github.com/moby/moby/issues/40188 limitations

  # tag image
  tagged_image="$IMPORTED_IMAGE_REGISTRY/$image_name:$IMPORTED_IMAGE_TAG"
  echo "Tagging image ID=$image_id as $tagged_image"
  docker tag $image_id $tagged_image
done

## Cleanup artifacts temporary dir
cd ~
rm -rf /tmp/vmclarity-images

@adamtagscherer raises important concerns and i would also like to add to this. Although we are not pushing PR images to GHCR, we could solve this by creating another (manually triggered) workflow that takes specific PR commit reference and pushes built artifacts for that commit to GHCR. This would allow us to test things, would also unblock community contributions, and it would also address the security concerns. My suggestion is that we add this action in a separate PR after this one is merged (it can be reused similarly to pushes to main).

I wrote a small PoC bash script that can import images from a specific GA pipeline run into local docker registry. I have tested it against GA run https://github.com/openclarity/vmclarity/actions/runs/9660640440. You need GitHub CLI to run this. Note that pulling artifacts can take some time. It can be used in case we use docker-only approach for E2E testing on cloud providers. It does not solve directly the second concern regarding CF file (unless it is extended with this script). But the suggestion above

@ramizpolic I also agree that there should be a way to manually upload to ghcr to further test changes, let's sit together and decide on a solution that works for everyone.
We had something like this created by @zsoltkacsandi recently in #1768, I removed it in this PR since essential parts of the workflow has been reworked, and I believe we need to adhere with the changes made on it.

lets just wait for #1828 #1794 to be merged first


support for a TR-based Haplotype class

we can extend the hap file format with a new line-type for tandem repeats
it should have the same fields as a haplotype line, essentially
and then we can create a new class similar to the Haplotype class but for reading tandem repeats and extend it within sim_phenotype.py to add a beta extra field
we would also still need to alter the Haplotypes class to support the new line type
we can also add a --repeats optional argument to the simphenotype command to specify a VCF file containing tandem repeats
then, after we load the tandem repeats internally, we can merge the genotypes from the GenotypesTR class with the Genotypes class to create a new Genotypes class, which we can then pass to the PhenoSimulator class

Resolved in #209 🥳


Added tests for Write

First part of changes to address #11584, I'll continue with StdCopy coverage next.