We only log image pull progress when it is done

Rancher Versions:
Server: v1.4.0-rc6 ish
When you deploy a container that requires an image pull, the go-agent doesn't log progress until the end. I observed this in the logs, but it may affect the progress shown in the UI as well.

Tested with 1.5.0-rc1. Pulled images golang and redis which did not exist on the hosts.
Able to see messages Storage : Downloading Storage:Extracting Pull Complete in the UI. Relevant messages are seen in the rancher agent logs as below:
time="2017-02-24T19:36:20Z" level=info msg="Reply: aeb32624-31d9-4dc2-9ca2-7ad37a8db0d9, storage.image.activate, 1ispm649:imageStoragePoolMap, transitioning: yes: Status: Downloaded newer image for redis:latest"
time="2017-02-24T19:36:20Z" level=info msg="rancher id [1ispm649]: Image with name [index.docker.io/redis] has been activated"
time="2017-02-24T19:36:20Z" level=info msg="Reply: aeb32624-31d9-4dc2-9ca2-7ad37a8db0d9, storage.image.activate, 1ispm649:imageStoragePoolMap"
time="2017-02-24T19:36:20Z" level=info msg="Received event: Name: storage.volume.activate, Event Id: f8c1cf0a-a54e-4461-a70e-63832813978a, Resource Id: 1vspm1128"
time="2017-02-24T19:36:20Z" level=info msg="Reply: f8c1cf0a-a54e-4461-a70e-63832813978a, storage.volume.activate, 1vspm1128:volumeStoragePoolMap"
time="2017-02-24T19:36:20Z" level=info msg="Received event: Name: compute.instance.activate, Event Id: 61629f4b-e44e-40a3-bf37-1f91768260f6, Resource Id: 1ihm650"
time="2017-02-24T19:36:21Z" level=info msg="Reply: 61629f4b-e44e-40a3-bf37-1f91768260f6, compute.instance.activate, 1ihm650:instanceHostMap, transitioning: yes: Pulling from library/redis"
time="2017-02-24T19:36:21Z" level=info msg="Reply: 61629f4b-e44e-40a3-bf37-1f91768260f6, compute.instance.activate, 1ihm650:instanceHostMap, transitioning: yes: Digest: sha256:fea8c36dc8bce366c52551f20bb40bacc248161b1391aa052ae9c7f00b647fd0"
time="2017-02-24T19:36:21Z" level=info msg="Reply: 61629f4b-e44e-40a3-bf37-1f91768260f6, compute.instance.activate, 1ihm650:instanceHostMap, transitioning: yes: Status: Image is up to date for redis:latest"
time="2017-02-24T19:36:21Z" level=info msg="rancher id [749]: Container with docker id [c99573ef1cc5273a5a2c184f110b5c77c5d1df151253183c9d15c96d07cf1d31] has been started"


do not ignore cog files

Cog files need to be excluded from the .dockerignore file to build this locally. Otherwise it produces an error
 => ERROR [stage-0 2/6] COPY .cog/tmp/build1149978451/cog-0.0.1.dev-py3-none-any.whl /tmp/cog-  0.0s
------
 > [stage-0 2/6] COPY .cog/tmp/build1149978451/cog-0.0.1.dev-py3-none-any.whl /tmp/cog-0.0.1.dev-py3-none-any.whl:
------
failed to compute cache key: "/.cog/tmp/build1149978451/cog-0.0.1.dev-py3-none-any.whl" not found: not found
ⅹ Failed to build Docker image: exit status 1

This happens because some files needed by cog are ignored by docker.

To run the built image you need to mount the project's root directory, where the cog.yaml file is. If you don't it fails with FileNotFoundError like shown below
❯ docker run -p 5000:5000 --rm image-super-resolution-cog
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/cog/predictor.py", line 72, in load_predictor
    with open(config_path) as fh:
FileNotFoundError: [Errno 2] No such file or directory: '/src/cog.yaml'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.7/site-packages/cog/server/http.py", line 104, in <module>
    predictor = load_predictor()
  File "/usr/local/lib/python3.7/site-packages/cog/predictor.py", line 76, in load_predictor
    f"Could not find {config_path}",
cog.errors.ConfigDoesNotExist: Could not find /src/cog.yaml


Shader module unit tests based on Transform class

Background
Currently there are no unit testing for shader modules, except for fp64, which is ver flaky and has been disabled. Given now we have Transform class, we can write simple unit tests for all shader module code without performing full rendering cycle.
To Do List

[X] Add label and assign to milestone
[ ] Coding

[ ] Add WebGL1 support for Transform using float textures.
[ ] fp64

[ ] Fix existing tests and port it to Transform

[ ] fp32
[ ] project
[ ] picking
[ ] lighting

[ ] Doc update
[ ] Whats new update

https://github.com/uber/luma.gl/issues/630


Change payout address impossible

I start the gui with the wrong payout address. I stoped the gui and start again with a new payout address. Everything in the gui is looking fine but my new payout address is not listet on the online list.
The reason for that is the registered auth address. There is no api call to update the payout address for the same auth address. https://github.com/Storj/dataserv-client/issues/55
Tested with 0.3.4 and 0.4.0 (develop branch)
What now? Should the gui delete the auth address to register a new payout address? That way the user will loose his uptime. We have to be carefull.

So that is the correct design. Payout addresses are "locked" to a payout address. This is both to avoid implementing tons secure change code, but also to remove edge cases for malicious actors.
If you need to change your payout address then you generate a new auth address.

So this is fixed in 0.4.1? It was not working in 0.4.0. I will try again and reopen the bug if needed. As long as the user can change his payout address in the gui but cant see his address at the online list i will call that a bug. We have to make the payout address at least read only.

Retest passed (gordonwritescode:bug/payout-address-change)
Fix will be in the next version after merge.


Batch-Capable Producer Bindings

(Current Batching Pattern) Batch-Accumulator Producer Bindings
Currently, the common batching pattern used by producer bindings is to accumulate messages at the producer binding based on batchSize and batchTimeout configuration and then bulk send to the target system. In a system where the consumer binding is also operating in batch-mode, this could look like the following:

The main challenges with the above are:

batch coordination between consumer and producer bindings is complicated. Both bindings need to operate on the same batch (aka work-unit) for acknowledgments to work. This gets complex on failure paths.
configuration for batchSize and batchTimeout exist at both bindings and need to be consistent. It is hard to reason about the two timeouts which are independent from each others.

(Proposed Enhancement) Batch-Capable Producer Bindings
What if a batch could be delivered to the producer binding as a whole and be handled all at once?

In the above:

Consumer binding accumulates a work-unit (a batch) based on its batchSize and batchTimeout configuration. It could be a partial batch.
The batch travels through the functions as a whole
The batch is served to the producer binding as a whole
The producer binding detects that the message is a batch and processes it as a whole. Once the whole batch is successfully processed, the producer binding returns successfully. If anything goes wrong, an exception is thrown.

Benefits of this design:

no coordination between consumer and producer bindings required. The batch (or partial batch) that arrives at the producer binding is simply what needs to be processed for that invocation.
batch related configuration only exists at the consumer binding. The consumer is the component responsible to create a batch (work-unit).
supporting batching at the producer binding is somewhat simpler with this design:

Full batch knowledge at every invocation.
no batchSize and no batchTimeout to implement

Worth noting that this design does not couple the producer binding to the consumer binding. The producer binding benefits from an already accumulated batch by the consumer binding; however, the producer binding remains completely independent from the consumer binding.
Spring Defined Header For Batched Messages
Batched messages already exist in Spring Cloud Stream. Here is a sample batch message which is produced by the Solace consumer binding:

The payload is of type ArrayList (in this sample, the batch is of size 3)
Top level headers are common to the entire batch
The header with key solace_scst_batchedHeaders holds actual message headers for every message within the batch.

Batch messages would benefit from a Spring defined header that is not binder specific.  Instead of solace_scst_batchedHeaders, a batched message could use scst_batchedHeaders which would be defined by Spring. This header would standardize the batch message format and would indicate to producer bindings that the message is a batch message and that it should be processed as such.
Final Note
Note that the proposed design can be implemented today with no issue, however, it is not a design currently endorsed by Spring. The goal of this issue is to bless this design and provide standards so that it could be implemented in any binders in a consistent manner.

Basically what you are asking (and I agree) is that effectively Consumer batch configuration take precedence over Producer based batch configuration if both present. This makes perfect sense to me. In fact as I am thinking about it. . . the Producer batch configuration would only make sense for cases where you are the source of stream (i.e., Supplier, StreamBridge etc). . . where nothing really coming in (consumed).

You are right, the proposed design removes the need for batch configuration at the producer. With the proposal, binders could provide 2 producer implementations:
IMPL-1: Producer is an accumulator (existing design where a producer has batch-size and batch-timeout config options)
IMPL-2: Producer is batch ready/capable (my apologies, finding a name for it has been challenging :) )
Details regarding IMPL-2:

for a batch of size n, the producer is called only once with a single batched message rather than n times for each individual message.
producer doesn't need to accumulate because the received batched message is already formed.
the received batch could be of various sizes. The producer can inspect the batched message and get the size if it needs to.

Binders are free to implement either implementation or both. Producer bindings could

provide a config option to toggle between IMPL-1 and IMPL-2 or
dynamically detect whether an incoming message is batched or not by looking for a newly defined Spring header ( potentially named scst_batchedHeaders). If the header is present, treat the message as a batched message (IMPL-2), if the header is not present, treat the message as an individual message (IMPL-1).

In summary, this is more than giving precedence to consumer binding batch configuration. The proposal attempts to define a new producer binding contract which is complementary to the existing contract. Interestingly, this can technically be implemented by binders today; however, this new contract would need to be defined/documented before implementations can be contributed back.

@carolmorneau I just pushed a branch with the initial commit of a class that defines scst_batchHeaders as well as a builder to build batch Message taking RabbitMq structure as an example. - https://github.com/spring-cloud/spring-cloud-stream/tree/GH-2969
Please take a look and see what is missing

Thank you @olegz
A few suggestions:

Would it make sense to define scst_batchHeaders within BinderHeaders?
This method public BatchMessageBuilder addHeader(String key, Object value) could potentially be renamed to addRootHeader(...) or something which differentiates from actual message headers.
Just an idea, but a utility to iterate through each message within a batch message could also be useful

@carolmorneau sorry for late response. Your suggestions seem reasonable so, i should update the branch tomorrow

@carolmorneau please take a look at the updated version and let me know your thoughts

@olegz Have you pushed your commit on the GH-2969 branch? I can't seem to see it https://github.com/spring-cloud/spring-cloud-stream/compare/main...GH-2969

All done, sorry, made some mistake when pushed it originally - https://github.com/spring-cloud/spring-cloud-stream/tree/GH-2969

Thank you @olegz, this looks good to us. This will allow us to standardize on scst_batchedHeaders.
Since this issue is also about getting the proposed design Spring approved, will there eventually be some related documentation updates?
For instance, some examples where a producer binding can receive a whole batched message at once and is capable of processing it in a single invocation.

@carolmorneau Sure, we can eventually update the docs, but we need reference something that is using it and for now our binders do not and I don't see them using it in a forceable future given that the corresponding kafka/rabbit headers are created upstream by the frameworks other then SCST.
Perhaps there could be some usage of the utility class even today, but let's see how it goes.
For now I would like to merge it to main so it can be included in the upcoming RC1
Please let me know if you have any objections.

Sounds good, this is good to merge
Thank you @olegz


Add extra attributes for device scanner, Nmap and Unifi (IP, SSID, etc.)

Description:
Add extra state attributes for device scanner :

Common : add device scanner name
Nmap : add last detected IP
Unifi : add last detected IP, SSID, BSSID, etc.

These attributes allows better control in automation scripts or templating.
Related issue (if applicable): fixes #
N/A
Pull request in home-assistant.github.io with documentation (if applicable): home-assistant/home-assistant.github.io#<home-assistant.github.io PR number goes here>
N/A
Example entry for configuration.yaml (if applicable):

N/A
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass

If user exposed functionality or configuration variables are added/changed:

[ ] Documentation added/updated in home-assistant.github.io
N/A

If the code communicates with devices, web services, or third-party tools:

[ ] New dependencies have been added to the REQUIREMENTS variable (example).
N/A
[ ] New dependencies are only imported inside functions that use them (example).
N/A
[ ] New dependencies have been added to requirements_all.txt by running script/gen_requirements_all.py.
N/A
[ ] New files were added to .coveragerc.
N/A

If the code does not interact with devices:

[ ] Tests have been added to verify that the new code works.
N/A

Hello, is someone reviewing this?
I use it with a binary template sensor to determine my phone position base on WiFi bSSID and signal strength

@MartinHjelmare Thanks, I took into account your comments in my branch. I do I update my pull request? Should I create a new one?

Yes, please create a new PR and rebase your branch on latest dev.

Should we realy update the old device_scaner code? cc @balloob
The best way is to migrate this to new callback system and we can remove the old one.


Fix link to GitHub 3d rendering API

There is no context for this PR, and it isn't linked to an issue.  I'm seeing this on the Watch Cases page; is this related?

Hi @synthead, yes, this is what my PR is supposed to fix.

Awesome, thanks!


feat: add direct synthesis method

This adds a way to use the 'Direct Synthesis API' to the SDK.
I've also cleaned up the utils.ts fetch requests as the code was hard to read on a single line. (I recommend the Prettier tool for this!)
The docs at https://docs.app.resemble.ai/docs/direct_synthesis should also be corrected with the following:

Under HTTP Response change phoneme_timestamps to audio_timestamps, which should look like this:

{
    graph_chars: string[];
    graph_times: [number, number][];
    phon_chars: string[];
    phon_times: [number, number][];
}

Under Response Body change phoneme_timestamps to audio_timestamps
Under Response Body, lowercase issues and success, and consider adding the following missing fields:

{
    duration: number;
    synth_duration: number;
    output_format: 'wav' | 'mp3';
    sample_rate: number;
}

Under Audio Timestamps Object, fix this table (it's currently jumbled up)

Let me know if you'd like any edits made! 🙂

Thank you for your contribution!


[BUG] JOIN query with object field in joined condition return nothing

What is the bug?
If a JOIN query uses object field in ON clause as joined condition, it will return empty.
How can one reproduce the bug?

Version: 2.x

Do you have any additional context?
Code: https://github.com/opensearch-project/sql/blob/2.x/legacy/src/main/java/org/opensearch/sql/legacy/query/planner/physical/node/scroll/SearchHitRow.java#L128
The getValueOfPath() finds object field value in source recursively. However, the source is already flatten as below:
source = {HashMap@17079}  size = 1
 "account.name.first" -> "John"

With a simple check, the problematic query can work. But not sure when the source format is changed. Or this function never work for object field?

After more test, I found out that the root cause is OpenSearch has different response format for object field. For the join-object-test index above, it returns:
{
   ...
    "hits": [
      {
        "_index": "jointest2",
        "_id": "As03gIUBc6yO9RmmbOSb",
        "_score": 1.0,
        "_source": {
          "account": {
            "name": "John"
          }
        }
      }
    ]
  }
}

But if the doc with object field is created as follows:
POST http://localhost:9200/join-object-test2/_doc/
{
  "account.name": "John"
}

OpenSearch returns:
POST localhost:9200/join-object-test/_search
{
  "took": 2,
   ...
    "hits": [
      {
        "_index": "jointest",
        "_id": "Ac00gIUBc6yO9RmmMeTE",
        "_score": 1.0,
        "_source": {
          "account.name": "John"
        }
      }
    ]
  }
}

Although both indexes have the exactly same mapping:
{
  "join-object-test": {
    "mappings": {
      "properties": {
        "account": {
          "properties": {
            "name": {
              "type": "text",
              "fields": {
                "keyword": {
                  "type": "keyword",
                  "ignore_above": 256
                }
              }
            }
          }
        }
      }
    }
  }
}

So the issue seems not only for JOIN in legacy code. V2 code also assumes the first response format. Need more investigation to confirm.

More tests for different response format:
POST http://localhost:9200/jointest3/_doc/
{
  "account": {
    "name.first": "John"
  }
}

"hits": [
  {
    "_index": "jointest3",
    "_id": "rhEAg4UBBxPx0bCIdbYG",
    "_score": 1.0,
    "_source": {
      "account": {
        "name.first": "John"
      }
    }
  }
]

POST http://localhost:9200/jointest4/_doc/
{
  "account.name": {
    "first": "John"
  }
}

"hits": [
  {
    "_index": "jointest4",
    "_id": "rxEBg4UBBxPx0bCITLby",
    "_score": 1.0,
    "_source": {
      "account.name": {
        "first": "John"
      }
    }
  }
]


Add package to conda-forge

Thank you for developing this nice package. I just tested it on my computer, and it works like a charm! I plan to incorporate the package into geemap and leafmap. Would you consider making the package available on conda-forge? Thanks.

I have been using xarray-leaflet to load local raster datasets to ipyleaflet maps. However, it does not support Windows (see https://github.com/davidbrochart/xarray_leaflet/issues/30) and it is not very stable on Linux. It usually fails to load large raster files.
Does flask-tileserver support Windows? I have yet to test it on Windows.

I'd be happy to get this on conda-forge... should be a breeze. Give me a few days as I'd like a little bit of the dust to settle before distributing on conda-forge.

Does flask-tileserver support Windows? I have yet to test it on Windows.

Assuming you can install GDAL, it should... though I do not use windows so I am unable to test it. There is some hackery going on with launching threads and using the thread IDs to keep track of which raster to serve so this may need to be tested on Windows.
What I can do is implement a Windows runner in GitHub Actions when I get around to #4

Does flask-tileserver support Windows? I have yet to test it on Windows.

@giswqs, all should be working on Windows according to the latest CI Tests I have on Windows

I will have to add lage_image to conda-forge before I can add flask-tileserver so this may take me a bit

I did test it on Windows, and it works fine. It appears that large_image and large_image_source_gdal are not available on conda-forge. Let me know if I can be of any help.

Work in progress here: https://github.com/conda-forge/staged-recipes/pull/17167


--versioned-definedBy option doesn't work with bundle operation

I get an unrecognized argument error when I run
onto_tool bundle --versioned-definedBy -v version 0.26.0 bundle.yaml

Based on the documentation, this option does not appear to be available with the bundle operation.
We would like to use versioned IRIs in rdfs:definedBy assertions for gist: see https://github.com/semanticarts/gist/issues/383.

My mistake - I misunderstood. The argument must be added to the bundle file.


Issue 999

Ok I will add FB and Twitter links..

Ok, I will add FB and Twitter links..
By the way, I was going to but forgot 😅
On 14 Oct 2017 8:06 p.m., "Sushant J"<EMAIL_ADDRESS>wrote:

@sushant-j commented on this pull request.
Hey @Abhishek-S-Sharma https://github.com/abhishek-s-sharma -
Everything seems good, but you have only added your github profile link.
It'd be great if you could you also add links to your other profile links
(say Twitter, FB, etc.)
You can check my implementation for reference.
If you don't want those I can merge this pull request as is.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/sushant-j/my-first-pull-request/pull/40#pullrequestreview-69393427,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AdaTaw5y6cN9Qcxsgu8ufLRcg9nncNjRks5ssMcJgaJpZM4P5UcH
.


feature: allow per task wait

Did you check the docs?

[X] I have read all the lazy.nvim docs

Is your feature request related to a problem? Please describe.
no, not a problem per sa, but it is a fairly unfortunate situation. We have workstations in cloud that only has limited network bandwidth and the VMs can't allow short high burst of egress traffic. Unfortunately, even if with checker.concurrency = 1, since each check is really fast, the overall speed is still too fast and bursty.
Describe the solution you'd like
It would be nice along with concurrency, we could specify a wait interval to further slow checkers down. e.g. if we could achieve some 1 task per 1s, that should help tremendously, or every time we just got 403 from github.
Describe alternatives you've considered
It does not appear one from the lazy doc. I've limited the task to 1 and still just too fast. Most of time, before all working checks done, the network already got disconnected.
Additional context
No response

FYI, there is already a 'wait' stanza, unfortunately, that's not good enough.
error we got
fatal: unable to access 'https://github.com/stevearc/oil.nvim.git/': Failed to connect to github.com port 443 after 19477 ms: Couldn't connect to server

This typically means we've burst too much :(

Unfortunately, even if with checker.concurrency = 1, since each check is really fast, the overall speed is still too fast and bursty.

https://github.com/folke/lazy.nvim/blob/d1de92dffab5a862332fdd1892889d362369c12f/doc/lazy.nvim.txt#L638
The second concurrency option exists.  It may work.

I already have
require('lazy').setup('plugins',
  { concurrency = 1, checker = { enabled = true, concurrency = 1, frequency = 2 * 86400, wait = true }, })

still too fast once checker is in working

Oh..

I'll see to add something for this this evening

I have a similar issue. In my case, I use HDD for disk and have limited network bandwidth.
It would be nice to have an option to select the previous behavior.

@mimikun what do you mean with previous behavior?

Before this commit: https://github.com/folke/lazy.nvim/commit/0614ca6ca629704cb1846c0d6f9a250b526900b9
After this commit, my plugin update speed, which was set to concurrency = 1, became incredibly slow (I've now tweaked it a bit and it's gotten a bit better. about: https://github.com/mimikun/dotfiles/blob/f64ba2b10333a65bc06e76aeefbb15f8ecdcdc99/dot_config/nvim/lua/core/lazyvim.lua#L4-L17).

I don't mean to pile on because this might certainly not be in scope for this plugin, but my corporate VPN too seems to be blocking :Lazy update.

I have the settings suggested above:
require("lazy").setup({
  concurrency = 1,
  checker = { enabled = true, concurrency = 1, frequency = 2 * 86400, wait = true },
  ...
})

The first few fetchs work fine and then once something fails it continues to fail. I checked with IT and they said the system was flagged these requests as suspicious.
If I'm off my company VPN it works fine so this isn't a deal breaker for me personally, just an annoyance.

Thank you folke! Life saving for us programming inside controlled environments, now I can have a way to tweak to the near allowed capacity and not got banded by our network policy!
One thing to point out, my previous config was like this
require("lazy").setup({
  concurrency = 1,
  checker = { enabled = true, concurrency = 1, frequency = 2 * 86400, wait = true },
  ...
})

The concurrency = 1 on the top-level needs to be taken out or it does not seem to honor the throttle. The concurrency = 1 inside checker seems fine, leaving out there still seem to honor the throttle.
Thank you again!!


Taylor approximations (or other approximation) for LOG2/EXP2/SIN in function.py passing all tests

Since mostly in all cases we will be introducing new lines of code to the code base (complexity without significant speed boost is not actually desirable), do we have any particular speed ups we can target in these approximation, or any speed boost will be acceptable?

Went to ask on Discord after reading some instructions.


Image Picker Freezes in Android when accessing OneDrive

I have upgraded from 1.12.13+Hotfix 5 to Flutter 1.19.0-4.3.pre and have 2 issues regarding ImagePicker 👍

Using ImagePicker 0.6.7+7 within Android (Simulator/Device)- accessing an image on OneDrive causes ANDROID to freeze when there are many (> 500) photos.

Accessing any other image on the local device or GoogleDrive etc works without issue.
On 1.12.13 with Image Picker  0.6.1+4 works without issue - even when there are > 500 photos.

Creating a brand new ONEDRIVE Account and having just 10 (MAX) photos to choose from causes ImagePicker to return null for PickedFile, i.e :

var image = await _imagePicker.getImage(source: ImageSource.gallery);
        if (image == null) {
          return;
        }

image will be null here when trying to access a ONEDRIVE source.
Both issues only happen in ANDROID.

Hi @sallypeters
Can you upgrade your flutter version (flutter upgrade) please and provide your flutter doctor -v

Hi @sallypeters,
Please see this comment which mentions that we need to apply explicit permission to request external storage access.
Also see this comment that has link to the updated readme of the plugin.
Please check if you have applied required permissions per guidelines.

@hamdikahloun Unfortunately I cannot upgrade from 1.19 because  a) Plugins I use have not yet upgraded themselves to support the new PodFile format that came into effect with 1.20, b) Using any Cloud Firestore package (Auth, Firestore, Storage) requires significant time to fix the many deprecation issues resulting in the complete re-write of the Transaction code in Cloud Firestore., c) The re-write from invertase for the cloud firestore TX  API has issues which prevents us from upgrading.
@darshankawar As mentioned, have been using the image picker with 1.12.13 without this issue and as far back as Flutter 1.1.2. If permissions were an issue then it would fall over accessing Google based cloud resources (google drive).
All appropriate permissions are in place for iOS and Android.
The issue is not permissions , security or anything else in terms of Podfile/Gradle configuration as other File plugins work seamlessly to access resources on cloud based platforms. The problem is with the image_picker plugin either not working properly in OneDrive or failing when there are lots of images for it to catalog as thumbnails ...

Hi @sallypeters
I tried to load an image from one drive using Android 8.1.0 device on latest beta and was able to load it properly without any issues.
66040.mp4.zip

flutter doctor -v
[✓] Flutter (Channel beta, 1.22.0-12.1.pre, on Mac OS X 10.15.4 19E2269, locale
    en-IN)
    • Flutter version 1.22.0-12.1.pre at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision 8b3760638a (12 days ago), 2020-09-15 17:47:13 -0700
    • Engine revision 4654fc6cf6
    • Dart version 2.10.0 (build 2.10.0-110.3.beta)

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6222593)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 11.5)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 11.5, Build version 11E608c
    • CocoaPods version 1.9.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 4.0)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 46.0.2
    • Dart plugin version 193.7361
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6222593)

[✓] VS Code (version 1.49.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.11.0

[✓] Connected device (3 available)
    • SM A260G (mobile) • 5200763ebcfa861f • android-arm    • Android 8.1.0 (API
      27)
    • Web Server (web)  • web-server       • web-javascript • Flutter Tools
    • Chrome (web)      • chrome           • web-javascript • Google Chrome
      85.0.4183.121

• No issues found!

Can you provide flutter doctor -v and flutter run --verbose when you get the freeze ?
Thanks.

Without additional information, we are unfortunately not sure how to resolve this issue.
We are therefore reluctantly going to close this bug for now.
Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.
Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.


Any improvement?

Thanks for sharing the repo. Do you achieve any improvement in comparison with training student only?

If I have detect hand, so the number of class will be 1 or 2? Am I right to change it to support hand detection?
            c_obj_scale = t_obj_scale.unsqueeze(-1).repeat(1,1,1,1,2)
            # if dist_loss == "kl":
            kl_loss = DclsLoss(F.log_softmax(pi[..., 5:]/T,dim=-1), F.softmax(t_pi[..., 5:]/T, dim=-1))*(T*T)

Thanks for sharing the repo. Do you achieve any improvement in comparison with training student only?

mAP will increase by 1-2%

If I have detect hand, so the number of class will be 1 or 2? Am I right to change it to support hand detection?
            c_obj_scale = t_obj_scale.unsqueeze(-1).repeat(1,1,1,1,2)
            # if dist_loss == "kl":
            kl_loss = DclsLoss(F.log_softmax(pi[..., 5:]/T,dim=-1), F.softmax(t_pi[..., 5:]/T, dim=-1))*(T*T)

right

In your code, you setup it as 5 as number of classes. Could you list 5 classes? Do you count background?

@John1231983 @xiao-hua-sheng Did you solve this problem? I have the same problem, do I need to count the background class?


error

trying to export the .whl file but I get this

WannaCRI needs a Python version of at least 3.8. Please upgrade your Windows Python installation https://www.python.org/downloads/windows/


Pipe to stdout?

Hi again! Do you happen to know if it's possible to output to stdout, for use with something like clickclack (audible/haptic feedback) or swipeguess (prediction/swipe input)? Normally, running wvkbd with the -O option outputs a character to stdout, so it can be piped to another program for further processing. I did try to add the option w/ a pipe to the puri.sm.OSK0.desktop file, and while Phosh started without error, the keyboard no longer displayed at all.

So I do have a hacky solution to this.  I can probably even toss this in a shell script to autorun after the first instance starts, and while that may very well work, it feels... gross. Won't stop me either way, but if there is a more elegant solution, I'll take it lol

Maybe try /bin/sh -c "command" in .desktop

Maybe try /bin/sh -c "command" in .desktop

That'd probably do it. So far I've just been experimenting with gesture typing, and trying different length/sorting for my wordlist, so manually starting from the terminal has been fine, but I think I've landed on something usable that I'll want to test more extensively.
Regardless, this doesn't really have anything to do with your code. StackOverflow probably would have been a better venue for this, lol.


Assistance Requested for Replicating CLIP Score Calculations from Your Paper

Dear Author,
I hope this message finds you well.
Firstly, I would like to extend my sincere compliments on your remarkable work. It has greatly assisted us in our research endeavors. However, I have encountered some challenges regarding the computational method used for the values in Table 1, specifically titled "Quantitative comparisons on CLIP [55] similarity with other methods."
In my attempt to replicate the results for the GaussianDreamer using CLIP, I was unable to achieve the reported score of 27.23 ± 0.06, 41.88 ± 0.04 as presented in your paper. My approach involved generating 10 random images based on the camera angles described in your paper, post which I utilized ViT-L/14 and ViT-bigG-14 models to compute the CLIP scores. I successfully generated results for 411 out of 415 prompts provided in the Dreamfusion project for this computation.
The outcomes of my calculations are illustrated in the attached image.

Could you kindly offer any guidance or share the specific code used for computing the CLIP scores as per your study? It would be incredibly helpful in understanding how to replicate the results you have achieved in your paper.
Thank you very much for your time and consideration. I am looking forward to your valuable response.
Best regards.

Dear Jiahui:
Regarding the issue of a large variance in the evaluation results, I have checked my code and your description, and I suspect it might be a matter of the evaluation perspective. When selecting the evaluation method, we have found that randomly choosing both azimuth and elevation can lead to a significant variance in the evaluation. To reduce this randomness, we have adopted a compromise approach. During evaluation, we fix the elevation value and only randomly select azimuth values to avoid obtaining a large variance. In practice, we will randomly select images from save-it1200. The specific code can be found in the attachment.
Best wishes.
clip_sim.txt

Dear Author,

I hope this message finds you in good health and spirits.

Following my previous communication regarding the replication of the CLIP scores presented in your paper on GaussianDreamer, I have attempted to use the code you provided to reproduce the results. Despite my efforts, I still find discrepancies between the scores reported in your paper and those I am able to achieve.

Specifically, using the provided code and the same methodology described in your paper, I am unable to replicate the CLIP scores of 27.23 ± 0.06 and 41.88 ± 0.04. I have meticulously followed the instructions, generating 10 random images based on the specified camera angles and computing the CLIP scores using both ViT-L/14 and ViT-bigG-14 models. I have successfully processed 411 out of 415 prompts from the Dreamfusion project.

The results of my latest attempts are included in the attached image for your review. The results are still the same values whether I use your code or my code about clip.

GaussianDreamer_0_laion-CLIP-ViT-bigG-14-laion2B-39B-b160k.json
GaussianDreamer_0_openai-clip-vit-large-patch14.json

Could you please provide additional insights or possibly a more detailed version of the code used in your study? Any additional parameters, configurations, or preprocessing steps that might be crucial for achieving the reported scores would be immensely helpful.

In addition, upon executing the provided code, I observed that the CLIP scores I obtained were consistently within the range of 0 to 1, such as a mean of 0.40. This differs from the scores reported in your paper, which appear to be multiplied by 100, resulting in values like 41.88. It seems that while the mean scores were scaled up by a factor of 100, the standard deviations were not adjusted accordingly, remaining at their original values as reported in the code.

This discrepancy could potentially lead to confusion among readers and researchers attempting to replicate your results. It would be beneficial to clarify whether the scaling of the mean scores was intentional and, if so, why the standard deviations were not similarly adjusted. It seems like this is an error.

Could you please provide an explanation for this scaling method and confirm whether the values in the paper should be interpreted as scaled or unscaled? Your clarification on this matter would be invaluable for ensuring the accuracy and integrity of the research based on your work.

Thank you very much for your attention to this matter. I look forward to your response and any additional guidance you may provide.

Best regards,

Dear Author,

I hope this message finds you in good health and spirits.

Following my previous communication regarding the replication of the CLIP scores presented in your paper on GaussianDreamer, I have attempted to use the code you provided to reproduce the results. Despite my efforts, I still find discrepancies between the scores reported in your paper and those I am able to achieve.

Specifically, using the provided code and the same methodology described in your paper, I am unable to replicate the CLIP scores of 27.23 ± 0.06 and 41.88 ± 0.04. I have meticulously followed the instructions, generating 10 random images based on the specified camera angles and computing the CLIP scores using both ViT-L/14 and ViT-bigG-14 models. I have successfully processed 411 out of 415 prompts from the Dreamfusion project.

The results of my latest attempts are included in the attached image for your review. The results are still the same values whether I use your code or my code about clip.

GaussianDreamer_0_laion-CLIP-ViT-bigG-14-laion2B-39B-b160k.json
GaussianDreamer_0_openai-clip-vit-large-patch14.json

Could you please provide additional insights or possibly a more detailed version of the code used in your study? Any additional parameters, configurations, or preprocessing steps that might be crucial for achieving the reported scores would be immensely helpful.

In addition, upon executing the provided code, I observed that the CLIP scores I obtained were consistently within the range of 0 to 1, such as a mean of 0.40. This differs from the scores reported in your paper, which appear to be multiplied by 100, resulting in values like 41.88. It seems that while the mean scores were scaled up by a factor of 100, the standard deviations were not adjusted accordingly, remaining at their original values as reported in the code.

This discrepancy could potentially lead to confusion among readers and researchers attempting to replicate your results. It would be beneficial to clarify whether the scaling of the mean scores was intentional and, if so, why the standard deviations were not similarly adjusted. It seems like this is an error.

Could you please provide an explanation for this scaling method and confirm whether the values in the paper should be interpreted as scaled or unscaled? Your clarification on this matter would be invaluable for ensuring the accuracy and integrity of the research based on your work.

Thank you very much for your attention to this matter. I look forward to your response and any additional guidance you may provide.

Best regards.

Hello Jiahui,
For our CLIP similarity issue, we present the JSON outcomes of our calculations. Unlike other approaches and the results you've shared, we employed all 415 prompts, as noted in Section A.1 of our paper. For the two ViT models—vit-l14 and vit-bigG-14—we compute the similarity ten times, each instance featuring different camera poses for the 3D assets, yet all based on the same once generation outcome. Hence, our ±0.06 and ±0.04 denote the variance across sampling various camera poses within the same once generation, specifically the variation across these ten computations, instead of differences between separate generative results. We do not assess discrepancies arising from diverse seeds and PyTorch versions affecting generative outcomes. Given the significant impact of generation outcomes by PyTorch and Lightning versions, we specify our evaluation versions: PyTorch=2.0.1, Lightning=2.0.0, to ensure reproducibility. In terms of table, fellowing instant3D, we scale both the variance and the score by a factor of 100, thus there's no issue of the variance not being amplified accordingly.
ViT-bigG-14_415_10_random_0.json
ViT-bigG-14_415_10_random_1.json
ViT-bigG-14_415_10_random_2.json
ViT-bigG-14_415_10_random_3.json
ViT-bigG-14_415_10_random_4.json
ViT-bigG-14_415_10_random_5.json
ViT-bigG-14_415_10_random_6.json
ViT-bigG-14_415_10_random_7.json
ViT-bigG-14_415_10_random_8.json
ViT-bigG-14_415_10_random_9.json
ViT-L14_415_10_random_0.json
ViT-L14_415_10_random_1.json
ViT-L14_415_10_random_2.json
ViT-L14_415_10_random_3.json
ViT-L14_415_10_random_4.json
ViT-L14_415_10_random_5.json
ViT-L14_415_10_random_6.json
ViT-L14_415_10_random_7.json
ViT-L14_415_10_random_8.json
ViT-L14_415_10_random_9.json


Video offset gets rounded up

Recently I discovered your website which help auto generating command for video fade and audio crossfade, it was a lifesaver for me.
But, theres one critical problem, the video offset. I was joining multiple videos like 4 videos at once and I used your script to fade and acrossfade the videos. Yes it is indeed taking a lot of time to join for almost a week long video, only to find out the audio is not syncing with the video.
I used 1 duration fade for the setting, and found out it can delay for like 3 seconds for 4 video.
Then i spent a lot of time figuring out why does this happen. I tried spliting the video and the audio to find out the output duration, did a lot of discoveries on the internet and lots of math, only to find out that the offset had to be -1 second.
Example, I had this script generated from your website:
name:
2024-04-09_11-08-02.mp4
duration:
10.273177
(seconds, float)
name:
2024-04-09_11-08-14.mp4
duration:
35.673177
(seconds, float)
name:
2024-04-09_11-08-51.mp4
duration:
37.639844
(seconds, float)
name:
2024-04-09_11-09-29.mp4
duration:
26.10651
(seconds, float)
name:
2024-04-09_11-09-57.mp4
duration:
30.373177
(seconds, float)
name:
2024-04-09_11-10-29.mp4
duration:
21.839844
(seconds, float)
Total video duration will be 161.905729 with no fade transition.
Since it has 6 videos, it will be -6s, means it supposed to be 155.905729 long.
ffmpeg -vsync 0 -c:v hevc_cuvid -i 2024-04-09_11-08-02.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-14.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-51.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-29.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-57.mp4 -c:v hevc_cuvid -i 2024-04-09_11-10-29.mp4 -filter_complex "[0]settb=AVTB[0:v];[1]settb=AVTB[1:v];[2]settb=AVTB[2:v];[3]settb=AVTB[3:v];[4]settb=AVTB[4:v];[5]settb=AVTB[5:v];[0]atrim=0:10.273177[0:a];[1]atrim=0:35.673177[1:a];[2]atrim=0:37.639844[2:a];[3]atrim=0:26.10651[3:a];[4]atrim=0:30.373177[4:a];[5]atrim=0:21.839844[5:a];[0:v][1:v]xfade=transition=fade:duration=0.5:offset=9.773[v1];[v1][2:v]xfade=transition=fade:duration=0.5:offset=44.946[v2];[v2][3:v]xfade=transition=fade:duration=0.5:offset=82.086[v3];[v3][4:v]xfade=transition=fade:duration=0.5:offset=107.693[v4];[v4][5:v]xfade=transition=fade:duration=0.5:offset=137.566,format=yuv420p[video];[0:a][1:a]acrossfade=d=0.5:c1=tri:c2=tri[a1];[a1][2:a]acrossfade=d=0.5:c1=tri:c2=tri[a2];[a2][3:a]acrossfade=d=0.5:c1=tri:c2=tri[a3];[a3][4:a]acrossfade=d=0.5:c1=tri:c2=tri[a4];[a4][5:a]acrossfade=d=0.5:c1=tri:c2=tri[audio]" -c:v hevc_nvenc -rc vbr -cq 30 -qmin 30 -qmax 30 -profile:v main -pix_fmt yuv420p -b:v 0K -b_ref_mode 0 -movflags faststart -c:a libopus -ar 48000 -b:a 96k -map "[audio]" -map "[video]" a.mp4
the video and audio were out of sync,
then i split the video and audio command, found out that:

The video was 00:02:39.43 long
The audio was 00:02:31.34 long

then I messed with the offset on the xfade filter based on how many videos to join and then offset -1.1s on the first transition, -2.2s on the second transition and so on:
ffmpeg -vsync 0 -c:v hevc_cuvid -i 2024-04-09_11-08-02.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-14.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-51.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-29.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-57.mp4 -c:v hevc_cuvid -i 2024-04-09_11-10-29.mp4 -filter_complex "[0]settb=AVTB[0:v];[1]settb=AVTB[1:v];[2]settb=AVTB[2:v];[3]settb=AVTB[3:v];[4]settb=AVTB[4:v];[5]settb=AVTB[5:v];[0]atrim=0:10.273177[0:a];[1]atrim=0:35.673177[1:a];[2]atrim=0:37.639844[2:a];[3]atrim=0:26.10651[3:a];[4]atrim=0:30.373177[4:a];[5]atrim=0:21.839844[5:a];[0:v][1:v]xfade=transition=fade:duration=1:offset=9.273[v1];[v1][2:v]xfade=transition=fade:duration=1:offset=43.946[v2];[v2][3:v]xfade=transition=fade:duration=1:offset=80.586[v3];[v3][4:v]xfade=transition=fade:duration=1:offset=105.693[v4];[v4][5:v]xfade=transition=fade:duration=1:offset=135.066,format=yuv420p[video];[0:a][1:a]acrossfade=d=1:c1=tri:c2=tri[a1];[a1][2:a]acrossfade=d=1:c1=tri:c2=tri[a2];[a2][3:a]acrossfade=d=1:c1=tri:c2=tri[a3];[a3][4:a]acrossfade=d=1:c1=tri:c2=tri[a4];[a4][5:a]acrossfade=d=1:c1=tri:c2=tri[audio]" -c:v h264_nvenc -rc vbr -cq 30 -qmin 30 -qmax 30 -profile:v main -pix_fmt yuv420p -b:v 0K -b_ref_mode 0 -movflags faststart -c:a libopus -ar 48000 -b:a 96k -map "[audio]" -map "[video]" a.mp4,
i got nearly the duration with the audio, 00:02:31.33
same with the audio:
ffmpeg -vsync 0 -c:v hevc_cuvid -i 2024-04-09_11-08-02.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-14.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-51.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-29.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-57.mp4 -c:v hevc_cuvid -i 2024-04-09_11-10-29.mp4 -filter_complex "[0]atrim=0:10.273177[0:a];[1]atrim=0:35.673177[1:a];[2]atrim=0:37.639844[2:a];[3]atrim=0:26.10651[3:a];[4]atrim=0:30.373177[4:a];[5]atrim=0:21.839844[5:a];[0:a][1:a]acrossfade=d=1:c1=tri:c2=tri[a1];[a1][2:a]acrossfade=d=1:c1=tri:c2=tri[a2];[a2][3:a]acrossfade=d=1:c1=tri:c2=tri[a3];[a3][4:a]acrossfade=d=1:c1=tri:c2=tri[a4];[a4][5:a]acrossfade=d=1:c1=tri:c2=tri[audio]" -c:v h264_nvenc -b:v 10M -map "[audio]" temp.wav
ofc I got 00:02:31.34
BUT, the audio still end up not syncing with the video
then i try the -1s offset on the video again:
ffmpeg -vsync 0 -c:v hevc_cuvid -i 2024-04-09_11-08-02.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-14.mp4 -c:v hevc_cuvid -i 2024-04-09_11-08-51.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-29.mp4 -c:v hevc_cuvid -i 2024-04-09_11-09-57.mp4 -c:v hevc_cuvid -i 2024-04-09_11-10-29.mp4 -filter_complex "[0]settb=AVTB[0:v];[1]settb=AVTB[1:v];[2]settb=AVTB[2:v];[3]settb=AVTB[3:v];[4]settb=AVTB[4:v];[5]settb=AVTB[5:v];[0:v][1:v]xfade=transition=fade:duration=1:offset=8.273[v1];[v1][2:v]xfade=transition=fade:duration=1:offset=41.946[v2];[v2][3:v]xfade=transition=fade:duration=1:offset=77.586[v3];[v3][4:v]xfade=transition=fade:duration=1:offset=101.693[v4];[v4][5:v]xfade=transition=fade:duration=1:offset=130.066,format=yuv420p[video]" -c:v h264_nvenc -rc vbr -cq 30 -qmin 30 -qmax 30 -profile:v main -pix_fmt yuv420p -b:v 0K -b_ref_mode 0 -movflags faststart -c:a libopus -ar 48000 -b:a 96k -map "[video]" temp.mp4
and i got 00:02:31.83
AND this is how it managed to sync with the audio somehow.
Update on this part:
After removing the atrim, I realised the duration of the video and the audio is not the same, that's why atrim is still needed.

I still can't confirm whether is my video's duration problem or the generative script -1s offset bug. I remember I did managed to work on first try but maybe I didn't even notice about the audio whether is sync or not, that was just 2 videos together so is not obvious, only when there's more videos to join. But in the end, I still managed to have a work around on this issue.
Please confirm this issue, Thanks!
Update 1: I did a lot of edits on this post since I keep experimenting with the values I go right now. I originally had this issue using 0.5 for the duration settings, but I think 1s duration could explain the issue better, does that mean 0.5s duration transition = -0.5s offset? i don't even know anymore lol.

Hi Ryan,
Thanks for your message. It is great digging work you did. I will try to look into it at the weekend when I have free time.
Thanks again.
P.S. I remember that I had the same problem with the sync. Maybe I need to refresh the algorithm with the knowledge I got in my other project.

Another update:
Recently I just found that I had to check for the audio length first, then recalculate the offset.
But, different kind of videos had different duration.
I had my one week long video being processed with the edited -1s offset, but it was still 2s early than the audio.
The audio was 179:58:48.38 long, then
The video I offset -1s was 179:58:46.53.
Since it became 2s earlier, I had to fallback to -0.5s offset, and the result:
The video was 179:58:48.07 long,
and I nearly got the audio to sync, just 0.3s early too.
New conclusion:
I think the first step of xfade transition multiple videos is:

Export the audio first, then get the total duration length
Calculate the total time the video will be output.

If for 5 videos and it has 2 seconds delay (early), all offset with your current generative algorithm will be offset -0.5s (Total will be +2s the duration).
If it late for 2 seconds, then it will be the opposite, +0.5s (Total will be -2s the duration)

Then combine audio and video together.

Hope this additional details could help you check the issue more easily!

Another update:
Forget about the offset thing on the main post.
After researching even more from the command to the internet, I know that:

atrim is so important that it match the duration of the video since the duration of the video and the audio doesn't even match
(ffprobe -i example.mp4 -show_entries stream=codec_type,duration -of compact=p=0:nk=1)
for my current project, there's one file that i used has the trim option (because the end of the video got corrupted), so i am afraid that when i used the end of trim duration, the offset will not match.
My biggest concern is that the generated command of the value had rounded up, it's better to have full value instead of rounded up, that's what I concern about it.

The video is really big that I had to wait for 20 hours to check if it's successful or not. This problem took me more than 1 week which I didn't expect it will turned out this way.
That's all about my update.
(Until now I am still waiting for my hypostasis to be confirmed)

Hi Ryan,
You did great job. I removed rounding in the code. I checked if it would help but the syncing was not worked. But additionally I added to the script from your examples aresample=async=1:first_pts=0,apad to the single atrim filter in the audio sript. And syncing worked. I checked on hour long video. aresample=async=1:first_pts=0: Resamples audio to synchronize with the video and I think this is the main which helped together with removing rounding.
Thanks again.
P.S You can check on the site updated version https://romander.github.io/ffmpeg-script-generator/

Thanks for resolving the issue.
I had verified that the updated site version is working well and the result, the video finally synced perfectly with the audio.
I have another recommendation on getting video duration, is to use this command:
ffprobe -i clip.mp4 -show_entries stream=codec_type,duration -of compact=p=0:nk=1
This will output both video and audio duration since both doesn't always match.
By the original command that everyone used:
ffprobe -v error -show_entries format=duration -of default=noprint_wrappers=1:nokey=1 input.mp4
I only get the longest duration:
174092.806511
but by my new command, I can get both video and audio duration:
video|174092.806511
audio|174091.840000
Sometimes the duration of the audio will be longer than the video
In the end, the atrm will do the job anyways, but for me, I will take the video as the duration of the video.
Thanks again for resolving the issue!


Merging Web APIs into JavaScript

When we think about "Web APIs" most people think about the DOM. But there are many Web APIs that are typically found in the standard libraries of languages. For example, it would make sense that there be a single core "crypto" library rather than two: (WebCrypto & NodeJS's built-in "crypto" package.
Crypto might not be the perfect example of a Web API that we could consider merging into JavaScript's stdlib. But it does often surprise people just how much of JavaScript comes from the Web. For example, setTimeout and setInterval are not part of JavaScript itself and they actually behave differently inside of Node than in browsers.
It's clear that more and more people expect to be able to share JavaScript in many different environments. JavaScript developers expect to be able to write code that works both in NodeJS and the Browser, not to mention all the other environments JS runs in engines specially made for IoT devices. Library authors have a lot of trouble making their code run anywhere and will often include handwritten ports of Node libraries to the browser which add many KBs of code that needs to be downloaded, parsed, and run.
I think it would make sense for TC39 to work with Web API standards bodies in order to merge some of them into JavaScript itself.

Most Web APIs have been specified taking in consideration only the needs of the Browser vendors. The semantics of most of some of those could not be matched 1-1 on non-browser environments, and as such they are extremely hard to port. From past experiences, it is hard to push Web APIs into Node.js: moving them into the language itself is only to cause more friction and problems for the community.
I agree that we need better interoperability, but the chasm is too big to cross. I think what we really need is a clear way to differentiate between language and web libraries, and communicate that to our users. There are going to be differences, because the interaction model is very different, so we should be transparent. Then, provide polyfills to cover those gaps.

I think OP's point is valid though and it is something we're trying to be better at. Namely, ensuring input from Node.js folks on APIs that make sense to expose outside the context of browsers is taken into account. And there's somewhat active interest in working together on IDL with the long term goal of harmonizing how we define APIs across standards bodies.
So yeah, perhaps not so much venue-swap, but definitely collaboration and harmonization.

we saw TypedArrays take several years before reaching spec compliance, and it's not clear that this effort led to benefits for programmers

I can tell you that this effort did lead to my benefit and I'm a programmer. I wrote an Electron app that works with binary data and TypedArray, ArrayBuffer, etc were all vital to converting this data between frontend and backend.
TypedArray is a perfect example of a great API that works well in the browser and in Node.js (and even in Electron) 😄

Making TypedArrays available across environments was definitely useful. Making them throw rather than return undefined when accessed after detaching them--not sure.

Why does the process have to be pulling web specs into TC39's process in order to be considered part of the JavaScript "standard library"? Why can't TC39 participate in other standards bodies and help design APIs to work for JavaScript as a whole? JavaScript Web APIs aren't all standardized by one body or one process anyways. There's already a lot of cross pollination between them. I would like to see us double down on working with Web standards and adopt them across communities

@jamiebuilds I am in complete agreement. What do you think of https://github.com/littledan/js-shared-interfaces as a way to work towards that?

Given that this is a TC39 repository, how would you feel about following up about standardizing some kind of "JavaScript standard base" in this issue: https://github.com/littledan/js-shared-interfaces/issues/11

I also feel like the OP. Putting this to the language makes the javascript environment less portable and implement and run interpreters in different scenarios (for example a microcontroller that suddenly needs to support this spec cause every second package needs some std: stuff and also has to provide the storage for the stdlib and whatever that stdlib needs e.g. kv-storage capability)
Its a browser problem, a browser feature and therefore it should be a browser api. The fact that a library is already in the browser and doesn't needs download is an odd argument to me, cause with caches, public cdns its already possible to prevent that loading if necessary.
Also it makes my application bundling more complicated again.
Cause to support older Browsers I would need to handle two entry points for my application (module and non module with polyfills).
This imo could probably result in a worse experience in the end, cause with dependencies of my app I eventually have an app one day that requires not only kv-storage but also foo-storage, bar-storage, nextbigthing-storage (and maybe in 5 versions each), Which might be no problem for the newest shiny browser but the bundle size for old-browser explodes.
So I don't really get why this can't be fixed in the browser api's itself. Or why the browser can't provide a reliably and fast storage solution without a std lib.
Last but not least, who defines what is coming into that stdlib? Browser vendors? Big players?

for example a microcontroller that suddenly needs to support this spec cause every second package needs some std: stuff and also has to provide the storage for the stdlib and whatever that stdlib needs e.g. kv-storage capability

kv-storage may not be needed in microcontrollers, but i think most JSON/string-related apis would be helpful ([decode/encode]URIComponent, Text[Decoder/Encoder], possibly Url class, etc...).
the use-case for wanting js in embedded-devices is not general-purpose programming.  its typically for either:

manipulating JSON data or
interfacing with the web (requiring url-parsing capabilities).

both of which ultimately are meant to achieve some bigger UX-workflow objective.

One of the things that makes Javascript a ubiquitous language is that there is a big ecosystem of packages and a very small language core. "Easy" to implement.
If there is now coming an implicit dependency to support the described module mechanism in the respective JS runtime and also the ecosystem is starting to adopt modules, which are then assumed to be available always (must not be kv-storage, can be others as you already mentioned) it can become harder to provide the js runtime.
Cause in this case it must be ensured that the module mechanism and maybe a "baseline" of modules are available in the target environment.
Otherwise a developer would need to watch out that all the dependencies and transitive dependencies don't depend on these, cause her environment may not support those.
And by the way, I use javascript on microcontrollers also to control sensors and actors. So please let us not put in concrete use cases here, cause we won't catch them all anyways.

@tobmaster I would expect that JS runtimes targeting those would at least let you compile out what you don't use. At the very least, Moddable XS lets you do that for both globals and built-in modules it provides.
Also, it's worth noting that kv-storage is being handled by WHATWG with the intent it could become part of their HTML family of standards, mostly independent of TC39. I'm not affiliated with either group, but I'm pretty sure I've seen affirmative confirmation by both groups stating it's not going to become part of ECMAScript itself. (It's a similar concept to Node's native modules like "util" and "events".)

One of the things that makes Javascript a ubiquitous language is that there is a big ecosystem of packages and a very small language core.

@tobmaster I'd say JavaScript is too small than a language should be, even console.log() is not part of JavaScript, but of Web API. I guess most develop would like to use console.log() regardless what the platform is.

@trotyl Most who aren't developing for embedded, that is. On embedded, you might not even have a console to print to, so it doesn't always make sense to have a console.log. In addition, on production servers, you generally don't just want to log everything to stdout - you probably want to log it to a file instead, and setting up Unix pipes and relevant infrastructure is a bit more complicated than just writing your server to write logs to a particular file via a new Console(fs.createWriteStream(...)) wrapper. (Node offers a console module exposing the Console class constructor itself to let you do stuff like that.)

@isiahmeadows ok how do I compile out kv-storage out of an npm module that depends on it? I honestly cannot see that can work.
Also we have two topics here that are already mixed up completely, kv-storage and that "standard library" loading mechanism. And while I have nothing against kv-storage itself, I don't understand why it cannot become a browser api like indexdb, localstorage and co...
I am also not affiliated with those groups. I just care cause JavaScript is more than just a browser language.
And indeed the module loading is part of ecmascript itself. So if someone interferes with that it has influence on all code.
@trotyl A small language core is still preferable in my eyes. Console log is also a browser api and supported easily or omitted. It doesn't belong to the standard youre right. But thats why you can see its already a problem cause everyone uses it for stuff. And thats a thing that would elsewise be missing sure. But its just output. Other modules are more demanding.
On embedded I can provide console.log and route it somewhere (tty or whatever) or I can just accept it and discard. Why I don't think console is a problem I already described.

@tobmaster

ok how do I compile out kv-storage out of an npm module that depends on it? I honestly cannot see that can work.

Using tools like Rollup, maybe? If it's using std:kv-storage, it's already declaring a DOM dependency, so you probably shouldn't be using it in other places.

Also we have two topics here that are already mixed up completely, kv-storage and that "standard library" loading mechanism.

That's not the intent. Look at the second paragraph of this comment - the intent is that it should be a Web API, just exposed in the form of an ES module rather than a global.

@tobmaster @trotyl Just to reiterate, the things that were seriously be suggested being moved into core in the original comment are things like AbortController/AbortSignal (which was really first discussed in TC39 circles) and crypto/Window.crypto, and we do already have a big thing that came out of web APIs into the standard. But not everyone agrees the effort is a good idea - the next two comments show a heavy level of skepticism around doing it broadly. The goal here is just to see what from Web APIs are broadly useful enough to merit being extracted and formed into standard library modules.

Most who aren't developing for embedded, that is. On embedded, you might not even have a console to print to, so it doesn't always make sense to have a console.log.

@isiahmeadows For those devices who don't have console, they can never have debugger as well. But debugger is still a built-in statement, which becomes no-op if no applicable. I think it's (for this specific case) more design issue than capability issue.

the scoped of builtins could be answered by this simple question:  "why as an embedded-dev do i want to embed javascript?"
i suspect valid reasons are (please correct me):

because i want device to interface net/web/intra-web
because i want device to manipulate JSON-data

if not any-of-above, then you made a mistake choosing javascript.
for use-case 1, you need a js-engine with same builtin-capabilities as nodejs (and likely sqlite3 as well).  this trivially includes console.log.
for use-case 2, you don't need a "standard" js-engine. a non-conformant, stripped-down es5-engine like duktape is perfectly fine for embedded JSON-manipulation.

Another valid reason to choose javascript is “for no other reason than i wanted to”, and that’s something we support too. (Not to mention the many many use cases that have zero to do with the web or with json, like robots or blockchain or wearables etc)

Not to mention the many many use cases that have zero to do with the web or with json, like robots or blockchain or wearables etc

@ljharb, can you elaborate on the robots, blockchain, wearable use-cases that don't deal with net/web or json?

Robots: http://johnny-five.io

@nicolo-ribaudo, johnny-five's stated-purpose is "Provides a powerful foundation for IoT projects", which is net/web [ux-workflow].  it doesn't make sense to use "pure" js-engine in johnny-five that lacks web-api capabilities.

It doesn’t make sense to you. It makes perfect sense to others. Please accept that and stop trying to claim that “web” or “json” or “UI” are the exclusive use cases for JavaScript - they are not.

agree to disagree.  ux-workflow is the dominant-problem faced by IT industry today.  javascript, robots, blockchains, wearables are simply tools/means for achieving ux-workflow solutions.  and javascript is popular because its the most efficient language for solving ux-workflow problems.
tc39's effort to decouple javascript from web-apis essential for solving ux-workflow problems is misguided.

If that’s true, then literally any feature added to javascript is eventually intending to solve a UX workflow problem, so either way your argument doesn’t decrease the value or motivation of any feature.

@kaizhu256

johnny-five's stated-purpose is "Provides a powerful foundation for IoT projects"

That's marketing copy from a Sparkfun product that happens to be based on Johnny-Five, not Johnny-Five's "stated purpose".

@kaizhu256  Just for reference reasons. If I have such a device https://tessel.io/ or this https://www.neonious.com
JS is not only web, json, web-api. Thats the point from which I am arguing. I hope its more clear to you now.

@tobmaster, those robot-kits have standard wifi/ethernet interfaces.  nobody would be interested in javascript for robots without web-interface capability.

@kaizhu256 and yet, many are, despite your beliefs in who should want what. I will again refer you to our Code of Conduct and remind you to please be inclusive and respectful, and be careful in the words you choose.

this might be ambitious, but exposing high-level [browser/os] api to convert html/css -> pdf -- and making it available in server-side js -- would be appreciated.


'rails generate rspec:install' stuck in rails 4.1.0

I'm using:
ruby '2.1.1'

# Bundle edge Rails instead: gem 'rails', github: 'rails/rails'
gem 'rails', '4.1.0'

group :test, :development do
  gem 'debugger'
  gem 'rspec-rails', '~> 2.14.2'
  gem 'uuidtools'
end
#...

I encountered a problem that it got stuck when install rspec with this command:
rails generate rspec:install

No log, no error message at all! However, when I terminated the command there's an error:
/Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/run.rb:47:in `gets': Interrupt
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/run.rb:47:in `verify_server_version'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/run.rb:19:in `call'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/command.rb:7:in `call'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/rails.rb:23:in `call'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client/command.rb:7:in `call'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/client.rb:26:in `run'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/bin/spring:48:in `<top (required)>'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/binstub.rb:11:in `load'
	from /Users/manvuong/.rvm/gems/ruby-2.1.1/gems/spring-1.1.2/lib/spring/binstub.rb:11:in `<top (required)>'
	from /Users/manvuong/Workspace/squar-ad-server/bin/spring:16:in `require'
	from /Users/manvuong/Workspace/squar-ad-server/bin/spring:16:in `<top (required)>'
	from bin/rails:3:in `load'
	from bin/rails:3:in `<main>

Any thought? Maybe this is a problem of https://github.com/rails/spring?

Worked for me also only after stopping spring

I just ran sprint stop and things started working.

Same here, but just a note for posterity that sprint stop is a typo and should be spring stop.

I'm going to lock this issue. Recent comments are merely confirming the issue resolution. If anyone runs into a similar issue not resolved accordingly, please open a new issue. :heart:


[Python APIView] CI test stage does not fail on actual test failure

However, the test stage and the PR overall are marked green by the CI.
https://github.com/Azure/azure-sdk-tools/pull/2255

@scbedd has fixed this issue. Thanks a lot for the fix.


Adds testing for kv-sort base case and fixes the current bug with it

This merge request adds tests for the base-case behavior of kv-sort, and fixes the current bug with it causing an infinite loop when it receives an array of size 0 or 1 as input.

Ah, darn. merge conflicts


Translations update from Foundry Hub - Weblate

Translations update from Foundry Hub - Weblate for Party Resources/main.
Current translation status:

@TravelingK Thank you very much!


total loss

Hi
First of all, thanks for implementing this. It's really awesome!
I'm currently modifying the codes to run it on OFFICE data set.
I found out that there is a small difference on the definition of total loss.
In the original paper, the total_loss is defined as :
predict_loss + lambda*domain_loss .
In the code, seems that the lambda term is missing.
I think that's one of the reasons that sometimes the total_loss would go crazy to NaN

Hi @jakc4103 ,
I think lambda is the l parameter in the flip_gradient
feat = flip_gradient(self.feature, self.l)
l is calculated as follows (see the Training loop in the MNIST-DANN.ipynb)
# Adaptation param and learning rate schedule as described in the paper
p = float(i) / num_steps
l = 2. / (1. + np.exp(-10. * p)) - 1
lr = 0.01 / (1. + 10 * p)**0.75

I have the similar problem as @jakc4103 when using AlexNet as feature network. The total_loss always goes to NaN for default adaptation param and learning rate. How to set the adaptation parameter and learning rate for handling the loss explosion ?

@Goldit sorry for my misunderstanding. You are right, lambda is a parameter in flip_gradient.
@yenlianglintw I think you can try to set the learning rate lower, or at least lower the learning rate at the pre-trained Alexnet layers. This should somehow solve the NaN loss problem.
But in my experience, sometimes the training won't converge for some reason I did not know. I think this probably is the reason why the original paper did not present all the 6 adaptation tasks on Office dataset.
BTW, another choice is don't fine-tune the parameters of the pre-trained model, just tuned the additional layers you added. this allows you to use a larger learning rate at training.


LookupError: gradient registry has no entry for: Svd

Hello All,
I am using singular values of the weights at each convolution layer as a regularizer and adding it in kernel_regularizer=self.l2_reg(). Where l2_reg is the function which return that.

        def l2_reg(weights):
                """ Reshaping the matrxi in to 2D tensor for enforcing orthogonality"""
                w = tf.identity(weights)

                """Calculating the Loss Obtained"""
                s1 = tf.linalg.svd(reg, full_matrices=True,compute_uv=False)
                ortho_loss = tf.nn.l2_loss(s1)
                return ortho_loss

Error I am getting is:
raceback (most recent call last):
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/ops/gradients_impl.py", line 551, in gradients
    grad_fn = ops.get_gradient_function(op)
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 2134, in get_gradient_function
    return _gradient_registry.lookup(op_type)
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/framework/registry.py", line 93, in lookup
    "%s registry has no entry for: %s" % (self._name, name))
LookupError: gradient registry has no entry for: Svd

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "run_dense_net.py", line 142, in <module>
    model = DenseNet(data_provider=data_provider, **model_params)
  File "/home/bansa01/densenet_final/tmp_spectral/models/dense_net.py", line 85, in __init__
    self._build_graph()
  File "/home/bansa01/densenet_final/tmp_spectral/models/dense_net.py", line 461, in _build_graph
    cross_entropy + l2_loss_total + reg_loss_total)
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/training/optimizer.py", line 343, in minimize
    grad_loss=grad_loss)
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/training/optimizer.py", line 414, in compute_gradients
    colocate_gradients_with_ops=colocate_gradients_with_ops)
  File "/usr/local/keras-python3/lib/python3.5/site-packages/tensorflow/python/ops/gradients_impl.py", line 555, in gradients
    (op.name, op.type))
LookupError: No gradient defined for operation 'Initial_convolution/conv2d/kernel/Regularizer/Svd' (op type: Svd)

I Understand that this is due to not able to calculate the gradient for SVD operation, but then how do I remove this issue.
Nitin

Please do provide all the information asked for in the issue template  (https://github.com/tensorflow/tensorflow/issues/new), for example which version of TensorFlow are you using?
Support for gradients of SVD was added in TensorFlow 1.5 (see https://github.com/tensorflow/tensorflow/issues/6503#issuecomment-335878473 and commit https://github.com/tensorflow/tensorflow/pull/13640/commits/e1d9e4ed05420ab9486bf18ec331e90e59e51982). Is it possible that you're using an older version?

I have been using tensorflow version 1.4.1.  I do see the commit going in. Do I just need to update my tensorflow?

Yes, can you try with version 1.5?

Nagging Awaiting Response: It has been 14 days with no activityand the awaiting response label was assigned. Is this still an issue?


ARC-0031 : Authentication with Algorand accounts

This PR introduces a refined version of ARC-0031 Authentication with Algorand accounts and replaces #84. The PR proposes the following changes/improvements to the old one:

Allowing signing of only random bytes - no transactions;
Allowing authentication with rekeyed accounts;
Allowig authentication with multisig accounts.

The ARC also includes a reference implementation (providing a simple authentication process - no rekey/multisig - with MyAlgoWallet) credits to mrcointreau

Hope this will get done soon. We definitely could use it.

Hope this will get done soon. We definitely could use it.

How do you see usage of ARC14? Arc14 does not require usage of signdata, but is using the txn.sign to authenticate person, so that it can be used now with any wallet connect capable wallets.

The living web standard, WebAuthn (Web Authentication API) supports the ed25519 elliptic curve and is also verifiable using other web standard API (Web Crypto through Crypto.subtle methods) or TweetNACL if that's your thing!
The process is clear and standard and also comprehensive and extendible (WebAuthn Extension points)! It is some how a superset of many standards now: FIDO Alliance, U2F, PassKey, Passwordless and many other unified under or derived from WebAuthn somehow (although backward compatibility with some much older versions is Iffy)!
The living standard, WebAuthn (Web Authentication API) supports the ed25519 elliptic curve and is also verifiable using other web standard API (Web Crypto through Crypto.subtle methods) or TweetNACL if that's your thing!
The process is clear and standard is comprehensive and extendible (WebAuthn Extension points)!
Very nice extensions like appId extension, User Verification Method extension and Credentials properties extension make it possible to add what ever data, metadata or procedure elements needed under Algorand scope and still comply to standard!
It has separated the two major concerns: Attestation and Assertation so that devs are free to implement limitless scenarios of identity and AAA using WebAuthn.
https://developer.mozilla.org/en-US/docs/Web/API/Web_Authentication_API
https://www.w3.org/TR/webauthn-2/#sctn-intro
Just a humble suggestion, that's all!

I humbly believe that using the composability of WebAuthn and Algorand (ASCs, ASAs and ATs plus Accounts) with a little team effort, a very well-structured identity and AAA framework can emerge that using federated identities can transparently and natively bridge Algorand blockchain identities to Web 2.0 identities via OAuth, Auth0, SAML,...

Given the status of ARC60 and also the fact that essence of this ARC (the arbitrary data signing and aside from process and flow) are there and in order to avoid redundant standardization, and also given the ARC80 which includes exactly the neccessary process and flow which complements ARC60, I propose to retire this ARC in favor of ARC60+ARC80 and given the fact that it is a bit too opinionated to be used with known third party Authentication frameworks like Oauth and OIDC (on top of Oauth) out of the box.
I also suggest all discussed best practices (rekeyed accounts, multisig support,...) to be moved from this to ARC60 to make it most efficient and comprehensive.
Briefly : ARC60 + ARC80 make a complete solution for authentication on Algorand which is 100% compatible with all known web standard frameworks and IETF RFCs.


BE-8167: List previous test results

Add enumerate results to db interface. Add endpoint to list them, using
an HTML template.
Needs #12.

I'd like to request that any visual changes (including adding a failed column) be done all at once after the primary PRs.


mixer is deprecated,but bookinfo demo policy and telemetry resource are still base on mixer,can you add demo base on wasm and telemetry v2

Describe the feature request
mixer is deprecated,but bookinfo demo policy and telemetry resource are still base on mixer,can you add demo base on wasm and telemetry v2
Describe alternatives you've considered
[ ] Docs
[ ] Installation
[ ] Networking
[ ] Performance and Scalability
[ ] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
Additional context

1.6 demo profile should already by default using telemetry v2. I am closing this issue and please reopen if you have any more question. thanks!


pushed another file

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@VincentV89 this PR is diverged too much from the head now. Could you rebase with master and create another PR, if there are any new features that you don't see in the master


Autocompletion for TypeScript does not work if I("Actor") has extensions in IntelliJ IDEA Ultimate

What are you trying to achieve?
Auto-complete in Intellij IDEA Ultimate for codeceptjs/typescript/puppeteer/mochawesome setup when "Actor"(I) is extended with custom steps file.
I did extension as described here: https://codecept.io/pageobjects/#actor
What do you get instead?
Auto-complete stoops working for parent methods and for custom ones.
STR
Example done with https://github.com/codeceptjs/typescript-boilerplate
I commented out in loginPage.ts method link:
  // async link () {
  //   await I.waitForVisible(this.locator)
  // }

and added same code to steps_file.ts
export = function (): any {
  return actor({
    // Define custom steps here, use 'this' to access default methods of I.
    // It is recommended to place a general 'login' function here.
	link: async function (): Promise<void> {
		  await this.waitForVisible(this.locator)
	  }
  });
};

Then added include to codeceptjs.conf.js:
  include: {
	I: 'steps_file.ts',

Then run codeceptjs def .
> codeceptjs def .
TypeScript Definitions provide autocompletion in Visual Studio Code and other IDEs
Definitions were generated in steps.d.ts

Then opened Typescript_Example_test.ts
And pointer mouse on any methods called from 'I'.
Result:
0 methods of I available for TS for autocomplete.

And if I don't do those changes - everything works as expected:

Details

CodeceptJS version:  3.0.0
NodeJS Version:14.15.1
Operating System:MacOSX
puppeteer
Configuration file:

require('ts-node/register')
const { setHeadlessWhen } = require('@codeceptjs/configure');
const { bootstrap } = require('./presettings.ts');

// turn on headless mode when running with HEADLESS=true environment variable
// HEADLESS=true npx codecept run
setHeadlessWhen(process.env.HEADLESS);

exports.config = {
  tests: './tests/**_test.ts',
  output: './output',
  helpers: {
    // Playwright: {
    //   url: 'https://github.com',
    //   show: false,
    //   windowSize: '1200x900',
    //   browser: 'chromium'
    // },
	  Puppeteer: {
		  url: './',
		  basicAuth: { username: 'user', password: 'pass' },
		  show: true,
		  windowSize: '1280x900',
		  waitForNavigation: "networkidle0"
	  },
    CustomHelper: {
      require: './CustomHelper.ts'
    }
  },
  bootstrap,
  include: {
	// I: 'steps_file.ts',
    loginPage: './loginPage.ts',
    homePage: './homePage.ts'
  },
  name: 'typescript-boilerplate',
  plugins: {
    retryFailedStep: {
      enabled: true
    },
    screenshotOnFail: {
      enabled: true
    }
  }
}

I am have the same observation as @daigo75.
Adding WithTranslation<Methods> manually to I definition fixes the issue.


[To rel/1.1] [IOTDB-5487] Fix the problem that the timestamp is "null" when using jdbc

see [IOTDB-3936]Add an interface in IClientRPCService to directly return bytebuffer instead of TSQueryDataSet
This pr is modified to add lastReadWasNull = false; of the constructOneRow method to the constructOneTsBlock method, resulting in a call to the next() method that meets the first of the following criteria, The lastReadWasNull field was not reset to false.

hi, This pr  nned submit master branch.


Connection failed. The joining node is already known to dqlite.

Summary
If, joining a new node fails for any reason, the joining node gets added to .dqlite, and the cluster has to be fully shutdown to remediate.
What Should Happen Instead?
Either, microk8s remove-node (broken ip) should work, or there should be a less impactful way to remediate.
Reproduction Steps
Have not tried reproducing.
BUT, On a production cluster running 1.25, I provisioned a new server, added microk8s, and microk8s add-node followed by join.
I failed to specify the correct channel, so, the new node now running 1.26 failed to join the cluster.
Not a problem, let me remove microk8s, and install the correct channel.
Contacting cluster at <IP_ADDRESS>
Connection failed. The joining node (<IP_ADDRESS>) is already known to dqlite (504).

https://microk8s.io/docs/restore-quorum
Is supposedly the method needed to resolve this issue, however, this is highly impactful to workloads, as the entire cluster has to be shutdown.
Related Tickets
https://github.com/canonical/microk8s/issues/2212
A few more details
root@kube01:~/Kubernetes/namespaces/readymotorsports.net# cat /var/snap/microk8s/current/var/kubernetes/backend/cluster.yaml
- Address: <IP_ADDRESS>:19001
  ID:<PHONE_NUMBER>608546238
  Role: 0
- Address: <IP_ADDRESS>:19001
  ID:<PHONE_NUMBER>747111275
  Role: 0
- Address: <IP_ADDRESS>:19001
  ID:<PHONE_NUMBER>7739305109
  Role: 0
- Address: <IP_ADDRESS>:19001
  ID:<PHONE_NUMBER>9447087085
  Role: 1
root@kube01:~/Kubernetes/namespaces/readymotorsports.net# microk8s remove-node <IP_ADDRESS>
Error from server (NotFound): nodes "<IP_ADDRESS>" not found
Node <IP_ADDRESS> does not exist in Kubernetes.
root@kube01:~/Kubernetes/namespaces/readymotorsports.net# kubectl get node -o wide
NAME     STATUS   ROLES                  AGE    VERSION   INTERNAL-IP    EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION      CONTAINER-RUNTIME
kube06   Ready    <none>                 83d    v1.25.5   <IP_ADDRESS>   <none>        Ubuntu 22.04.1 LTS   5.15.0-58-generic   containerd://1.6.8
kube01   Ready    control-plane,master   95d    v1.25.5   <IP_ADDRESS>   <none>        Ubuntu 22.04.1 LTS   5.15.0-58-generic   containerd://1.6.8
kube05   Ready    <none>                 108d   v1.25.5   <IP_ADDRESS>   <none>        Ubuntu 22.04.1 LTS   5.15.0-58-generic   containerd://1.6.8

I will note,
Just changing the IP/hostname of the joining node, allows it to join.
root@kube04:~# microk8s join redacted
Contacting cluster at <IP_ADDRESS>
Waiting for this node to finish joining the cluster. .. .. ..
root@kube04:~# kubectl get nodes
NAME     STATUS     ROLES                  AGE    VERSION
kube05   Ready      <none>                 108d   v1.25.5
kube06   Ready      <none>                 83d    v1.25.5
kube01   Ready      control-plane,master   95d    v1.25.5
kube04   NotReady   <none>                 6s     v1.25.6
root@kube04:~#

I had similar problem. Simple microk8s leave and re-joining cluster did the trick for me.

same issue

You could also try to do a microk8s remove-node <node-ip> --force to make sure dqlite has removed this IP from the nodes it knows. We fail adding nodes with IPs dqlite already knows about so we do not risk corrupting the datastore.

Guys-
I don't need a work-around. I have work-arounds!
This ticket, is so that hopefully somebody fixes the underlying issue causing this.

Steps to reproduce after creating a 3 CP node cluster:

microk8s leave on one of the nodes.
microk8s remove-node <IP> on the same node (not the correct way to do remove-node)

After this, the node gets removed
# k get no
No resources found

But it still is not removed from /var/snap/microk8s/current/var/kubernetes/backend/cluster.yaml.
Doing a microk8s remove-node <node-id> --force from a different node resolves it.


AI is so Boring 😴... We Need Hoomans 🎨

Most of the mockups are generated by AI (e.g. logo, assets). They are just placeholders... and they are meh. But, we need real human designers to replace them with something imaginative and awesome! If you’re human and have wild ideas, feel free to submit your Mockups to make this SaaS app truly come alive!
Requirement: Must be humanly designed because to design is to be human, and to be human is to design.

It looks like most of the users on GitHub are bots, which is honestly a little depressing, ngl. Closing this issue as wontfix due to the severe shortage of human brainpower around here. Maybe one day, GitHub will upgrade its bots to actually solve real issues/problems instead of just pretending to be human. Stay strong, fellow humans (if there are any left). 🙃


PR: Update SocialShare.astro to call the right Whatsapp.astro

Bug

SocialShare.astro is trying to import WhatsApp.astro when it's actually Whatsapp.astro - which breaks on Case Sensitive Operating Systems.

Fix

Call Whatsapp.astro instead of WhatsApp.astro

This looks to be a duplicate of #12


Marker missing style defined by custom MarkerLabelFormatter

How to reproduce
I pulled the source code and edited the sample chart 3.
Here is the diff I made
marker_styling_issue.patch
Observed behavior
Looking at the video you can see the Marker in the middle doesn't have any style.
https://github.com/patrykandpatrick/vico/assets/129093932/2494fd1f-ea93-43f9-aeeb-574825b5748e
Expected behavior
Marker in the middle should rendered the same way as the others.
Vico version(s)
Latest unstable version -> v2.0.0-alpha.12
Android version(s)
Emulator with version 33
Additional information
No response

Hello! Thanks for the report. We’ll look into it.

Thanks, @SebPawp! I’ve been able to reproduce this on a virtual Pixel 6 Pro. I previously used a virtual Pixel 3a, a virtual Pixel 6, and a real Pixel 7, and the problem didn’t occur on any of those devices.

Vico 2.0.0 Alpha 14 fixes this. Cheers!

I confirm, it's working for me with Vico 2.0.0 Alpha 14!
Thank you for the quick fix.

Thanks for confirming. You’re welcome!

Vico 1.15.0 Alpha 1 addresses this.

Vico 1.15.0 is now available.


feat(region): add tags implement

这个 PR 实现什么功能/修复什么问题:
feat(region): add tags implement
google, huawei server tags

是否需要 backport 到之前的 release 分支:
-- release/3.7

/cc @ioito @zexi
/area region

Codecov Report

Merging #9691 (de8118f) into master (2b47be4) will increase coverage by 5.97%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master    #9691       +/-   ##
===========================================
+ Coverage    5.99%   11.97%    +5.97%
===========================================
  Files         844      231      -613
  Lines      131395    25747   -105648
===========================================
- Hits         7879     3082     -4797
+ Misses     122815    22354   -100461
+ Partials      701      311      -390

Flag
Coverage Δ

aFlag
11.97% <ø> (+5.97%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/compute/models/dns_zones.go

pkg/keystone/models/roles.go

pkg/util/seclib2/crypto.go

pkg/compute/models/loadbalancer_common.go

pkg/keystone/models/credentials.go

pkg/compute/models/snapshotpolicy.go

pkg/compute/models/instance_snapshots.go

pkg/multicloud/ucloud/storage.go

pkg/hostman/system_service/docker.go

pkg/mcclient/options/loadbalanceracls.go

... and 603 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2b47be4...de8118f. Read the comment docs.

/lgtm

/lgtm
/approve


Replace the current predict cache file storage with Redis

Currently the prediciton cache is storage in memory we should use Redis instead

How is prompt cache should work? Do you mean that on the same prompt we should produce the same response? It is correct? Usually AI agents have variative responses (not necessarily the same response on the same prompt).
Also, what do you mean by Free Redis? Free software Redis?

@vporton I have updated the description

Current memory cache is limited to 30 entries. Should I also limit the number of entries in new Redis cache? (BTW, maybe you know how to limit the amount of entries in Redis?)

Why PredictCache uses base64 encoding, not simply puts strings to the cache? This seems meaningless for me.


Community Roles: disallow creating Task for instructor/trainer, who has been inactivated

As an admin user, I want to be unable to create a trainer or instructor task for a person, whose trainer or instructor community role has been inactivated.
Acceptance criteria:

adding instructor or trainer task to an event is blocked if related person's instructor or trainer community role is inactive
adding instructor or trainer task to a person is blocked if related person's instructor or trainer community role is inactive
creating instructor or trainer task is blocked if selected person's instructor or trainer community role is inactive

@pbanaszkiewicz  has this been completed?

@maneesha No, not yet. I'll work on it this week.

@maneesha This is what I'm implementing:

Adding instructor task is blocked if person has no active instructor community role
Adding instructor task to TTT event is blocked if person has no active trainer community role

The difference is that:

Person could potentially have multiple instructor or trainer community roles, and I'm checking if all of them are inactive
Acceptance criteria were defined as if either inactive instructor or inactive trainer community role would block adding a task. Instead I switched to checking for inactive instructor community role for instructor task, and inactive trainer community role for trainer task (instructor in a TTT event).


Update image used for htmlproofer

It should have more up to date ca-certs

I think a rebase should fix the semaphore failure.

rebased


Preserve content mode when animation view is replaced

Because we're setting the content mode directly on _animationView (see commit 89775d9f6e2b7d768771f43b62454c0d154412c3), we need to copy it when the animation view is replaced.

@emilioicai Would it be possible to get this merged in? I am right now having to use the fork 😬 and would prefer to switch back to an official release.

@fedegl done :)

@emilioicai Awesome thanks!


Huggingface checkpoint link not accessible

Dear Author,
It seems that the link for checkpoints is not available.

Sorry for the oversight. I've now made my Hugging Face project public.

Sorry for the oversight. We've now made the Hugging Face link public.

Thanks for the update!


Running GenerateResourcesAndImage causes error, hangs if automated - win2022

Description
A couple of notes. I'm trying to automate the building of an Azure Pipelines Agent image and I'm using GenerateResourcesAndImage to do so. If that is the wrong place to start let me know. I'm running this in an Azure Pipeline using Windows hosted agents. Basically this (with the steps to get the code and install az from psgallery
    - powershell: |
        Set-Location $(Agent.BuildDirectory)\virtual-environments
        Import-Module .\helpers\GenerateResourcesAndImage.ps1
        GenerateResourcesAndImage -SubscriptionId "*****" -ResourceGroupName "$(resourceGroup)" -ImageGenerationRepositoryRoot "$pwd" -ImageType Windows2022 -AzureLocation "East US" -AzureClientId "*****" -AzureClientSecret "*****" -AzureTenantId '*****' -Force
      displayName: Build the Image

Currently I'm getting this error

==> vhd: Provisioning with powershell script: D:\a\1\virtual-environments\images\win/scripts/Installers/Install-AzureCli.ps1
vhd: Install the latest Azure CLI release
vhd: Downloading azure-cli.msi...
vhd: Downloading package from: https://aka.ms/installazurecliwindows to path C:\Users\packer\AppData\Local\Temp\azure-cli.msi .
vhd: Package downloaded successfully in 3.75 seconds
vhd: Starting Install azure-cli.msi...
vhd: Non zero exit code returned by the installation process: 1618
vhd: Total time elapsed: 4.08 seconds
==> vhd: Script exited with non-zero exit status: 1618.Allowed exit codes are: [0]
==> vhd: Step "StepProvision" failed
==> vhd: [c] Clean up and exit, [a] abort without cleanup, or [r] retry step (build may fail even if retry succeeds)?
##[error]The operation was canceled.
Finishing: Build the Image

Is there a way to make this a silent success or failure? Or have a flag that defaults to "clean up and exit?" As it stands when this happens the job times out after 6 hours and there is still a temporary resource group left.

Virtual environments affected

[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] macOS 10.15
[ ] macOS 11
[ ] macOS 12
[ ] Windows Server 2019
[X] Windows Server 2022

Image version and build link
windows-latest
Is it regression?
No response
Expected behavior
No response
Actual behavior
No response
Repro steps
basically run the GenerateResourcesAndImage.ps1 in an azure pipeline. I would like it if

It succeeded, and
If there is a failure, it didn't hang

Hey @jeffpuckett.
You should remove -on-error=ask in https://github.com/actions/virtual-environments/blob/12cbf387cabe5494daf18f449097bc6eb899cb27/helpers/GenerateResourcesAndImage.ps1#L284

so should i submit a PR then? I would prefer to pull from the official source and not have to maintain a fork.

Merged https://github.com/actions/virtual-environments/pull/5635 PR.


v6 high order components problem

Hi, with the v6 version, I have problems using a redux-form with the redux "connect".
Practically if I use 2 high order components (one for the redux store using "connect" and one for redux-form using "reduxForm"), it doesn't work if I use redux-for as the first one.
But it works if I use it as the second one (It was working in previous versions).
The following code doesn't work (the component is not updated when the state.data object is updated in the redux store)
const MyComponentForm = reduxForm({
  form: 'eventsFilter'   // Unique name for this form (to register it in the Redux global store)
})(MyComponent);

export default connect(
  mapStateToProps,
  mapDispatchToProps
)(MyComponentForm);

While the following code works:
const MyComponentConnect = connect(
  mapStateToProps,
  mapDispatchToProps
)(MyComponent);

export default reduxForm({
  form: 'eventsFilter'   // Unique name for this form (to register it in the Redux global store)
})(MyComponentConnect);

Hmmm.. it's working in the example.
I'd need to see the code of your mapStateToProps and mapDispatchToProps functions to help further.

While browsing I found this might be related to the issue I just reported as well: https://github.com/erikras/redux-form/issues/906

seems to be fixes in v6.0.0-alpha-7, as commented in #906

Closing based on @nktssh's comment.