How do I make my YouTube data cumulative?

I've wanted to do an Abacaba-styled video with this tool. But then I tried to export my YouTube video's view count and it looks like this.

If I put that data in the Abacaba Graph Drawer tool. Then it's going to fluctuate.
I asked this on the part 1 video's comment section. I only got a "There's no way" reply, and there was radio-slience after.
The guy claimed that post-late-2018 videos counts the total views over time, but I exported a post-late-2018 video and it was still the same fluctuating mess.
Here's the problem, I have uploaded a total of 450-525 videos over a period of almost 7 years. I cannot count manually the total views for 450-525 videos. I did try to do an "animated graph video" of my videos earlier last year, however, because of the "all videos' views are counted separately each day" issue, i ended making my data incomplete and smooth because I found the process too tedious.
Before I wrote this, I looked on YouTube and Google if there was any way of counting the videos' total views for each day, but my results were only "How YouTube counts views" and shoddy attempts at trying to advertise VidIQ's paid features.
So, my question is, is there any way of counting the total view of a YouTube video for each day? I don't care if this requires a retro version of Python along with Ubuntu 14.04 or whatever, I just want to do the video, without it being inaccurate.
This probably isn't the best place, but as I said, the comment section only lead me to another way of saying "I don't know".

YouTube > YouTube Studio > Content > Click on a video you want to see > Analytics > On the graph, click See More > Hover on the graph to see data points.
That's it.

YouTube > YouTube Studio > Content > Click on a video you want to see > Analytics > On the graph, click See More > Hover on the graph to see data points.
That's it.

This does not work. The title of my issue says "How do I properly count the views of YouTube videos without it flutuating in the graph?", not "How do I check how manys views the video had in a day?".
If I paste this data, the bars will not grow gradually, instead, they will have a spasm because the data isn't the total views over time.

This does not work. The title of my issue says "How do I properly count the views of YouTube videos without it flutuating in the graph?", not "How do I check how manys views the video had in a day?".
If I paste this data, the bars will not grow gradually, instead, they will have a spasm because the data isn't the total views over time.

Well then you will have to add each data point manually.
For example, to calculate the number of views on January 1, 2019 on a video that is published on January 1, 2018, you have to add all the previous data points before January 1, 2019, inclusive. That's a total of 366 data points.
Or if you have some calculus skills, it's a integral calculation.

Well then you will have to add each data point manually.
For example, to calculate the number of views on January 1, 2019 on a video that is published on January 1, 2018, you have to add all the previous data points before January 1, 2019, inclusive. That's a total of 366 data points.
Or if you have some calculus skills, it's a integral calculation.

I'm dropping this video idea entirely. Cary/Micheal seems to have forgot about their "We'll make a animated graph about your video's views" after 1 video, and it only serves as a shoutout. Ethier I do it manually for a video that no one will care about, or I will end up killing my YouTube channel because a hundreds (or thousands) of logokids subscribed to my channel after they saw a video about my channel on Abacaba.

I'm dropping this video idea entirely. Cary/Micheal seems to have forgot about their "We'll make a animated graph about your video's views" after 1 video, and it only serves as a shoutout. Ethier I do it manually for a video that no one will care about, or I will end up killing my YouTube channel because a hundreds (or thousands) of logokids subscribed to my channel after they saw a video about my channel on Abacaba.

the confusion might have been caused by me not saying the word "cumulative", which is what i'm actually looking for.

the confusion might have been caused by me not saying the word "cumulative", which is what i'm actually looking for.

You can just make the data cumulative using Google sheets' built-in features?
https://productivityspot.com/running-totals-google-sheets/
This tutorial's purpose isn't to provide users with every possible data-processing operation. A generally good idea is to get familiar with playing around with large datasets in general using Python, SQL, or any other programming language. Because then you can figure out how to do apply any operation you'd like!


keybased.sock not being created

I'm a new keybase user and I signed up today. I have an Ubuntu 16.04 server and was able to successfully install the software and running run_keybase doesn't spit out any errors. The /run/user/1000/keybase only contains keybased.info which contains a time-stamp of when I ran the command so it appears that the program has access to the directory.
The keybased.info file contains the version and a pid number that isn't referencing a valid process.
All commands result in an error: ERROR dial unix /run/user/1000/keybase/keybased.sock: connect: no such file or directory.
XDG_SESSION_DIR is set to /run/user/1000
XDG_SESSION_ID is set to 1
my log id: d39c58e48b9cad7ba1f15d1c

I've solved the issue by looking at the run_keybase bash file and running the keybase command directly. It told me what was wrong: it didn't have permissions to ~/.local/share/
The ~/.local directory was created by root (in setting up the server, I ran sudo commands and another application, as root, created the directory) and keybase didn't have permissions to write to the .local directory.


Convert token to text

Is there a way to convert the output (currently in the form of tokens) of the model to text for easy interpretation and testing?

For example, the annotator marks the long answer using byte offsets, token offsets, and an index into the list of long answer candidates:
"long_answer": { "start_byte": 32, "end_byte": 106, "start_token": 5, "end_token": 22, "candidate_index": 0 }.
How to map these bytes and tokens to the text containing the answer.

you might want to try something like this
import jsonlines

INPUT_FILE = "nq-train-sample.jsonl"
START_TOKEN = 3521
END_TOKEN = 3525
QAS_ID =<PHONE_NUMBER>785278785
REMOVE_HTML = True

def get_span_from_token_offsets(f, start_token, end_token, qas_id,
                                remove_html):
    for obj in f:
        if obj["example_id"] != qas_id:
            continue

        if remove_html:
            answer_span = [
                item["token"]
                for item in obj["document_tokens"][start_token:end_token]
                if not item["html_token"]
            ]
        else:
            answer_span = [
                item["token"]
                for item in obj["document_tokens"][start_token:end_token]
            ]

        return " ".join(answer_span)

with jsonlines.open(INPUT_FILE) as f:
    result = get_span_from_token_offsets(f, START_TOKEN, END_TOKEN, QAS_ID,
                                         REMOVE_HTML)

print(result)

you can read your prediction file to get the various start_tokens, end_tokens, and example_ids, then iteratively call the function to get a list of the prediction spans (write to file or whatever)
hope this helps!


Need to export Variance to be able to use SweepAndPrune generically o…

…utside the crate

bors r+


MatchError on macro expansion

Hey, first of all I want to say that I really enjoy using ammonite :)
Problem
I've been getting a following error lately:
cmd2.sc:8: exception during macro expansion:
scala.MatchError: [x]fs2.Pure[x] (of class scala.reflect.internal.Types$PolyType)
	at pprint.TPrintLowPri$.typePrintImplRec0(TPrintImpl.scala:151)
	at pprint.TPrintLowPri$.typePrintImplRec(TPrintImpl.scala:32)
	at pprint.TPrintLowPri$.$anonfun$typePrintImplRec0$7(TPrintImpl.scala:103)
	at scala.collection.immutable.List.map(List.scala:246)
	at pprint.TPrintLowPri$.added$2(TPrintImpl.scala:103)
	at pprint.TPrintLowPri$.printArgs$1(TPrintImpl.scala:106)
	at pprint.TPrintLowPri$.typePrintImplRec0(TPrintImpl.scala:200)
	at pprint.TPrintLowPri$.typePrintImplRec(TPrintImpl.scala:32)
	at pprint.TPrintLowPri$.typePrintImpl(TPrintImpl.scala:21)

          .print(res2, "res2", _root_.scala.None)
                ^
Compilation Failed

Reproduction steps

launch ammonite cs launch ammonite --scala 2.13.8
run following code:

import $ivy.`co.fs2:fs2-core_2.13:3.2.4`, fs2._

Stream.emits(Seq(1,2,3))

Machine spec

Ammonite 2.5.2
Scala 2.13.8 / Scala 2.13.6
Java 17.0.2 (but I've tried version 11 too)
Apple M1 Pro Chip - this might be important, as I don't recall getting this error on other machines

Encountered it again and found out this make it compile:
Stream.emits[fs2.Pure, String](Seq("a"))

It seems like the problem is type bound F[x] >: fs2.Pure[x] in fs2

It seems it's been fixed in recent Ammonite versions. I can't reproduce that with 2.5.5 (while I can with 2.5.2).

@alexarchambault You're right - in 2.5.5 the problem is gone 🙃 I always launch amm with cs launch ammonite --scala 2.13.8 so by default it starts 2.5.2 version and I assumed it's always the newest one. Closing this then.
BTW I'm not sure if this is ammonite problem or coursier, but running cs launch ammonite --scala 2.13.9 fails with:
Resolution error: Error downloading com.lihaoyi:ammonite_2.13.9:latest.release

but this:
cs launch com.lihaoyi:ammonite_2.13.9:2.5.5 -M ammonite.Main

works fine. 🤷🏼♂

BTW I'm not sure if this is ammonite problem or coursier,

Yeah, there are issues in the automatic Scala suffix logic, in coursier…


Download CSV doesn't work when location selection is used

E.g. https://findthatcharity.uk/orgid/type/registered-charity?q=&location=E12000007
Clicking "Download CSV" results in a failed download.
error:
FieldError: Cannot resolve keyword 'locations' into field. Choices are: active, addressCountry, addressLocality, addressRegion, alternateName, charityNumber, companyNumber, dateModified, dateRegistered, dateRemoved, description, domain, email, id, latestIncome, latestIncomeDate, linked_orgs, name, orgIDs, org_id, org_id_scheme, org_id_scheme_id, organisationType, organisationTypePrimary, organisationTypePrimary_id, parent, postalCode, scrape, scrape_id, source, source_id, spider, status, streetAddress, telephone, url
  File "ftc/views.py", line 191, in stream
    s.run_db()
  File "ftc/query.py", line 283, in run_db
    self.query = Organisation.objects.filter(*db_filter)
  File "django/db/models/manager.py", line 85, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "django/db/models/query.py", line 941, in filter
    return self._filter_or_exclude(False, args, kwargs)
  File "django/db/models/query.py", line 961, in _filter_or_exclude
    clone._filter_or_exclude_inplace(negate, args, kwargs)
  File "django/db/models/query.py", line 968, in _filter_or_exclude_inplace
    self._query.add_q(Q(*args, **kwargs))
  File "django/db/models/sql/query.py", line 1416, in add_q
    clause, _ = self._add_q(q_object, self.used_aliases)
  File "django/db/models/sql/query.py", line 1435, in _add_q
    child_clause, needed_inner = self.build_filter(
  File "django/db/models/sql/query.py", line 1288, in build_filter
    return self._add_q(
  File "django/db/models/sql/query.py", line 1435, in _add_q
    child_clause, needed_inner = self.build_filter(
  File "django/db/models/sql/query.py", line 1309, in build_filter
    lookups, parts, reffed_expression = self.solve_lookup_type(arg)
  File "django/db/models/sql/query.py", line 1135, in solve_lookup_type
    _, field, _, lookup_parts = self.names_to_path(lookup_splitted, self.get_meta())
  File "django/db/models/sql/query.py", line 1562, in names_to_path
    raise FieldError("Cannot resolve keyword '%s' into field. "

Now fixed in 64502d4ab5a2727be8c87e080130be131ca73d7e


TypeError: Cannot read property "0" from undefined

I get this error whenever I try switching to factory preset #2. Bitwig 3.1.2 on macos.
Otherwise, the script works fine, thank you very much.

Sorry for the slow response. Thanks for letting me know. I get the error in Bitwig 3.1 too. I'll try to fix it.

Ok, I think I found the problem. Try installing the latest version: https://github.com/adamjmurray/bitwig-launch-control/archive/master.zip
That should fix it! Let me know if it doesn't.


When install with whl file and error occurred.

When you run "pip install dist/*.whl" in the first step of README's Usage > Generation - Python, a build error in pyarrow occurs.

Using cached rpds_py-0.18.1-cp312-cp312-macosx_10_12_x86_64.whl (329 kB)
Using cached smmap-5.0.1-py3-none-any.whl (24 kB)
Building wheels for collected packages: pyarrow
Building wheel for pyarrow (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for pyarrow (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [324 lines of output]
:36: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
WARNING setuptools_scm.pyproject_reading toml section missing 'pyproject.toml does not contain a tool.setuptools_scm section'
Traceback (most recent call last):
          ArrowConfig.cmake
          arrow-config.cmake

        Add the installation prefix of "Arrow" to CMAKE_PREFIX_PATH or set
        "Arrow_DIR" to a directory containing one of the above files.  If "Arrow"
        provides a separate development package or SDK, be sure it has been
        installed.

      -- Configuring incomplete, errors occurred!
      error: command '/usr/local/bin/cmake' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects

We are phasing out *.whl support, so closing this issue.


Map scaling issue

Scalling a map function is broken at dashboard
Console: Error: Invalid value for  attribute cx="NaN"

I think that map should be updated to something else as current vector map node.js module in this template is deprecated.


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-archive-test-target-new/pull/2 is merged into live branch.
Auto archive content to https://github.com/OPS-E2E-PPE/docs-archive-test-target-new.git

Docs Build status updates of commit d131aa0:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

.openpublishing.redirection.json
:white_check_mark:Succeeded

archvieSourceFolder/TOC.yml
:white_check_mark:Succeeded

archvieSourceFolder/content/someContent.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Update DockerHub trigger url

Docker image now lives in hawkularorg repo: https://registry.hub.docker.com/u/hawkularorg/hawkular/
Update trigger url to reflect new location.

Thank you Viet


theme suggestion

I don't know where else to put this, but could you add a theme that uses ubuntu's color palette?

Hi! Greate idé i will start looking in to it and then submit it to the site!

Hey sorry. I'm not on github a lot, and I didn't see the email until now, but I got the file you linked on my page and I love the theme you chose. Thank you so much!


BUG: Inonsistency in fonts of headings

Describe the bug

While other headings in index.html have font: Poppins and font-size: 32px, 'Contact Us' heading has font: Noto-Serif, font-size:44.8px
Expected behavior
All headings in the web-page must be consistent, i.e., must have same font-style and font-size
Screenshots (Mandatory)
Other headings:
Contact Us Heading:

Expected:

Additional Context (Mandatory )
Are you contributing under any open-source program ?
Yes, I am a contributor in GSSoC'24

please assign me this issue

can you check this out @apu52

Hi,
I am GSSOC'24 Contributor. Could you please assign me this issue. I am having experience in working with web development projects. I think I can handle it .

i would like to work on it. please assign me this task under GSSoC'24.

Assign me this issue

@divyalaldinani You are assigned. you can start working on this issue.

@apu52  please assign me this issue


Question: Only install, when the system don't has a JRE installed?

Is it possible to only install the JRE, when the system doesn't have one?
This would lead to better performance for the one who already installed the correct version.

As pointed out in #18, I'll discontinue this project.


combine selected files/folders into dat

Wiki: https://www.wiki.sc4devotion.com/index.php?title=DBPF
scala https://github.com/memo33/scdbpf
java https://github.com/memo33/jDBPFX (derived from: java https://sourceforge.net/projects/sc4dbpf4j/)
go https://github.com/marcboudreau/godbpf
python https://github.com/fbstj/dbpf (also stale C#, c, ... branches are here in varying states of completion, but most are far from complete)
php https://www.wiki.sc4devotion.com/index.php?title=DBPF_Source_Code
js https://github.com/sebamarynissen/sc4/blob/master/lib/dbpf.js

[ ] strip out unnecessary files (LD files, ...)


RFE: Add support for signing UTF-8 text

The Firefox web browser used to support a javascript function called crypto.signText() that presented some text to the end user, and invited the user to sign the text with a digital certificate.
This was removed from the Firefox project without a replacement.
I propose the same functionality be added to hwcrypto.js, so as to make it possible to sign text as was possible before.
Linked issues: https://github.com/open-eid/chrome-token-signing/issues/165

Such implementation is not in the scope of this small interfacing/integration library, as explained in linked issue.


float() argument must be a string or a number, not 'ExponentialDecay'

Hello, I get the following error when I use tf.keras.optimizers.schedules.ExponentialDecay, as it says in the documentation. Can anyone help me with it? Thank you!

I've faced the same issue. Keras is imported from tf.
TF version: 2.4.0

@swel4ik,
Sorry for the delayed response. Is this issue resolved? If not, can you please share the complete reproducible code so that we can look into it?
Also, give a try with initial_learning_rate=0.1, as shown in the documentation. Thanks!

@swel4ik,
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you.

Closing as stale. Please reopen if you'd like to work on this further.

I am facing the same problem. Also with TF 2.4.0.


Playing a station from TuneIn

Hello, I'd like to play a station from TuneIn, not sure what to populate in the guide Id field? Appreciate any assistance.
Here's the tuneIn URL https://tunein.com/radio/3AW-693-s7007/

Thanks

Not sure if you resolved this, I think you just need to put in the "s7007" as the id.
https://help.tunein.com/what-is-my-station-or-program-id-SJbg90quwz

Not sure if you resolved this, I think you just need to put in the "s7007" as the id.
https://help.tunein.com/what-is-my-station-or-program-id-SJbg90quwz


Problem when running the example

Hello! I was trying to run the example project following the steps in the instructions and at first after using  python manage.py migrate I got the ModuleNotFoundError, this thread helped me to fix it, but not at all. When running python manage.py runserver it returns this;
 Exception in thread django-main-thread: Traceback (most recent call last): File "C:\ProgramData\Anaconda3\lib\threading.py", line 917, in _bootstrap_inner self.run() File "C:\ProgramData\Anaconda3\lib\threading.py", line 865, in run self._target(*self._args, **self._kwargs) File "C:\ProgramData\Anaconda3\lib\site-packages\django\utils\autoreload.py", line 54, in wrapper  fn(*args, **kwargs)  File "C:\ProgramData\Anaconda3\lib\site-packages\django\core\management\commands\runserver.py", line 139, in inner_run ipv6=self.use_ipv6, threading=threading, server_cls=self.server_cls) File "C:\ProgramData\Anaconda3\lib\site-packages\django\core\servers\basehttp.py", line 203, in run  httpd = httpd_cls(server_address, WSGIRequestHandler, ipv6=ipv6) File "C:\ProgramData\Anaconda3\lib\site-packages\django\core\servers\basehttp.py", line 67, in __init__ super().__init__(*args, **kwargs) File "C:\ProgramData\Anaconda3\lib\socketserver.py", line 452, in __init__self.server_bind() File "C:\ProgramData\Anaconda3\lib\wsgiref\simple_server.py", line 50, in server_bind HTTPServer.server_bind(self) File "C:\ProgramData\Anaconda3\lib\http\server.py", line 139, in server_bind self.server_name = socket.getfqdn(host) File "C:\ProgramData\Anaconda3\lib\socket.py", line 676, in getfqdn hostname, aliases, ipaddrs = gethostbyaddr(name) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xcf in position 0: invalid continuation byte
Could you help me to find our what causes this error?

My computer's name contained cyrillic characters, changing it to latin helped to fix this error, and now everything works fine :)


Fix bug: [ILVerify] Class implements interface but not method

fixes https://github.com/dotnet/corert/issues/6707
Replaced with correct helper that scan the type and its base types for an implementation of an interface method https://github.com/dotnet/corert/blob/master/src/Common/src/TypeSystem/Common/TypeSystemHelpers.cs#L352
/cc @jkotas @MichalStrehovsky

test Windows_NT Release please

@dotnet-bot test Windows_NT Debug and CoreCLR tests please


Added publications section and with a matching style of the rest of the CV

I was hoping to complete #23 PR. I have made some changes so that the publications section matches the style of the rest of the CV.
Related PR #23 #152
Related issues #271 #38

@zeshuaro Can you please submit a PR against aminmkhan/Awesome-CV?


Subscription guidance

Please provide some guidance about the potential need for a dedicated subscription? How should Purview fit into the overall tenant architecture, landing zone and governance model

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 8868c56f-f02e-475b-7e7a-2db4abaf2b84
Version Independent ID: bf20ce93-60e9-36ff-f4e8-22ad9f626ba9
Content: Deployment best practices for Microsoft Purview (formerly Azure Purview) - Microsoft Purview
Content Source: articles/purview/deployment-best-practices.mdS
Service: purview
GitHub Login: @shsandeep123
Microsoft Alias: sandeepshah

Thanks for the feedback! We are currently investigating and will update you shortly.

@DeanGross ,
Since this issue is not a document feedback, It looks more like product question,  I would recommend you to create a thread on the forums - Microsoft Q&A or Stack Overflow
Once you post your issue on forums, it will have visibility across the community which is a better suited audience for such types of issues.
Thanks !


Master Sync

Testing if it's useful to update branches from the master?

Never mind, I see the only changes are the commits. :)


ADLS

TODO: Double check encoding in all getFile/getDirectory methods in FileSystem and DirectoryClient

/azp run java - storage - ci

Adding an issue for support for url encoding https://github.com/Azure/azure-sdk-for-java/issues/6130


Zoom in when focus on input

Error Zoom in when focus on input
When try use a form inside the drawer component, the browser does a zoom and broke the layout of drawer, how can fix it?
Video
https://github.com/emilkowalski/vaul/assets/21252506/eeab1005-cb42-41c9-84c9-44249146f348
https://github.com/emilkowalski/vaul/assets/21252506/db8cd75c-e8bf-4a03-8719-cb1e798c8350

Hey, @DavidRojas1612! How did you ended up fixing this?

Hey, @DavidRojas1612! How did you ended up fixing this?

+1

Hi @DavidRojas1612
Can I know how you fixed it? I am having a similar issue

@97albertus try making your font size larger (16px maybe?). Safari zooms in by default if your input size is smaller than a certain size to make it easier for people to see what they are typing

I was able to fix it with repositionInputs={false} root prop
https://vaul.emilkowal.ski/inputs#no-repositioning


Fix typed.List return value

Fixes #6523

Thanks for the patch. This change could do with a test adding please, ideally from the reproducer in #6523. It'd also be good to look at the related items in https://github.com/numba/numba/issues/6523#issuecomment-734771361 if time is available. Thanks again!
CC @esc please could you coordinate on this/review, thanks.

@stuartarchibald , from your comment, do you mean that instead of return _extend(self, iterable) it should do _extend(self, iterable) without return?

@stuartarchibald , from your comment, do you mean that instead of return _extend(self, iterable) it should do _extend(self, iterable) without return?

Yes. I'm in two minds about it. Perhaps its best if all the extend functions return the result of the extend, which should be None, such that if there is erroneous behaviour at least it propagates and can be caught. Thoughts?

Personally I would return the result of the function as it's currently doing, but I don't know the advantages of the other approach, so I cannot compare.
Usually, the only return that I avoid is a return None as last line.
In interpreted python both approaches are the same, does it make a difference in jitted code?

I've assigned this to myself and will get to it on Monday.

This looks fine so-far, the reminaing TODOs on this appear to be:

Figure out which other extend type functions return self
Decide on how to handle internal returns?

@stuartarchibald  @luk-f-a Does this sound right?

I just took a look at the source-code. If we decide to return from _extend we should adopt this coherently for other in-place modification functions that also return None such as, for example, insert.

Hmmm, many of the functions seem to do this already: insert, clear, reverse for example.

hi @esc, while I opened this PR to take care of extend I can also take care of the first point "Figure out which other extend type functions return self" in this PR. Typeguard didn't detect any other cases, but the code is not long, I can look manually.
The second point is up to you and Stuart to decide, I can make the changes in this PR if you'd like.

Probably a good idea to separate concerns here and fix the immediate issue first, i.e. making sure nothing returns self. Then , deal with the question of "should functions that return None, return the result of internal calls to make sure None is always returned at" in a second PR? Does that sound like a good plan of attack?

I checked manually and using Pycharm that nothing else is returning self. It seems that nothing else is.

@luk-f-a thanks for looking into this. I hav reviewed this and it is ready to merge now.


How to retrieve the value from a conversation drop down?

(Describe your issue and goal here)
Have the following code below. This shows a list of the channels. I want to get the value of the channel selected, ex: if a user selects general, I want to be able to get that value. I have the following code after it. A little bit confused on how to approach this.
Reproducible in:
slack-bolt==1.15.1
slack-sdk==3.19.1
Python 3.7.10
Steps to reproduce:
{
"type": "section",
"block_id": "channel_selection_list",
"text": {
"type": "mrkdwn",
"text": "Pick channel from the list"
},
"accessory": {
"action_id": "channel_selection_action",
"type": "multi_conversations_select",
"placeholder": {
"type": "plain_text",
"text": "Select channel",
"emoji": True
}
}
},
@app.action("channel_selection_action")
def show_multi_options(body, ack, logger):
ack()
logger.info(body)
OS info
#1 SMP
Amazon Linux 2
Expected result:
When a user selects a conversation from the drop down menu, I want to be able to retreive which channel was selected and be able to store in a local variable.
Actual result:
When the the channel is selected and the confirm button is clicked, no action is done because I am unsure of how to approach this. Ive already created a function for the action_id I just do not know what logic to use to approach this

Hi @bg339, Have you made sure to subscribe to Interactivity in your apps App Config page? It's possible that Slack doesn't know to send your app events for user actions on your apps drop down menu .
You can head to https://api.slack.com/apps --> select your app -->  Interactivity and Shortcuts

Yes I have interactivity and shortcuts enabled! Im able to do other functions i.e clicking a button and it being able to send a message. I am designing the UI/UX right now. The screenshot below is what the UI looks like for the survey creator. My issue is related to the portion where it says create survey. I have an action_id associated with the channel selection but I am not able to retreive which channel is selected. I also attached a screenshot of the code.


Web app corrections leave lines for very flat surfaces

The correction functions of the web app don't work well for very flat surfaces. While this doesn't change the statistics too much, the topography images don't look great on the web app.
I usually use Gwyddion Scan Line Alignment before I upload my data to avoid this. As an example I attached topo images of DLC, one corrected before with Gwyddion.

This is the function I use to correct the scan line offsets
http://gwyddion.net/documentation/user-guide-en/scan-line-defects.html

I've added the label enhancement, because this is really a request for an advanced correction tool.


Is there a way to give the planner a pre-planned global path?

I have a global path and want the local plan to follow this path. Is it possible to do this using the teb_local_planner?

This is precisely what TEB is used for. Please read the docs.

I'm sorry, I think the question was asked in the wrong way. I tried to ask for the use of a custom path passed to TEB as an input. Not the one generated when publishing a Goal.
I have a path message that stores a series of points building for example a circle. How can I do the TEB planner follow these points?

Hey, Diego. Sorry to sound a little rude, but this is really what TEB is used for.
You did not give much information, but I believe that what you are looking for is using TEB as a plugin. Either as a nav_core::BaseLocalPlanner or a mbf_costmap_core::CostmapController plugin (there is support for both). Maybe it is easier if you to start here http://wiki.ros.org/nav_core.

Thanks for your response. I must say you that It is precisely what I do. I use the TEB as a pluging. It is configured using the base local planner parameter of move_base node. However your response helped me to learn how to modify the global planner to provide a custom path to the local planner (TEB) (this was what I asked). Can you recommend me a way to generate this custom path through via-points?. The TEB has implemented this functionality but it doesn't work.

No problem, Diego. What about generating your global plan multiple times to go through the viapoints if you really want to reach them?

I don't want to do it because I would have to re-plan each time I reached a viapoint and the movement would not be continuous.
I followed this tutorial (http://wiki.ros.org/navigation/Tutorials/Writing A Global Path Planner As Plugin in ROS) to set up the global planner plugin. If you look, the points that form the global path are calculated within GlobalPlanner::makePlan just for illustration purposes.
How can I subscribe to a topic for example to /clickedpoint from RVIZ to draw the path myself and pass it to the plugin to work with these points? I can't subscribe to any topic from the plugin.

I don't want to do it because I would have to re-plan each time I reached a viapoint and the movement would not be continuous.

If your viapoints are known beforehand, you can always call the global planner for each consecutive pair and then feed this complete path to TEB. If a viapoint is received while moving, then just replan when that happens.

How can I subscribe to a topic for example to /clickedpoint from RVIZ to draw the path myself and pass it to the plugin to work with these points? I can't subscribe to any topic from the plugin.

The local planner is used as a plugin. So the one responsible for subscribing to a topic is the node that is making use of the plugin.

Thanks @jcmonteiro !. But how I can feed this complete path to TEB?. That's exactly why I'm thinking about how to subscribe to a topic from the plugin

No problem. You just need to call the method TebLocalPlannerROS::setPlan in your TEB instance to update the global plan whenever there is a new one available. Then, your next call to TebLocalPlannerROS::computeVelocityCommands will already return the velocity as a solution to the updated plan.

After a hard day of work and once several issues of compilation were solved, I was able to build the teb_local_planner plugin from source.
Before this I was using the pre-built version of TEB.
I have seen the methods that you tell me... I will try to do what you recommend and I will tell you. Thanks!

I added a new topic in TEB to receive the new path. When using the  TebLocalPlannerROS::setPlan method, the local planner begins to follow the path that I design, however I have seen that 2 paths are being received, the one generated by me and the one that comes from the move_base node. How can I stop the plan that comes from the move_base node?  Additionally you told me to call the  TebLocalPlannerROS::computeVelocityCommands  method but this method receives as argument cmd_vel ... how can i call it correctly?

jcmonteiro let me know if you know how I can stop the plan coming from the move_base node.  As I said you before, 2 global plans are being received, the one generated by me and the one that comes from the move_base node. Thank you for your help

jcmonteiro let me know if you know how I can stop the plan coming from the move_base node.  As I said you before, 2 global plans are being received, the one generated by me and the one that comes from the move_base node. Thank you for your help

So I think I am doing the same thing as you. I create a map to localize in with rtabmap_ros, then I run a my custom python script (I call it Path Creator) that subscribes to the /rtabmap/localization_pose topic and saves the translation(x,y) and orientation(x,y,z,w) to a text file. Then I followed this tutorial to create my own global plugin that I call GlobalPathInjector that reads from the text file created by Path Creator when you trigger a goal. (the goal/start pose does not get used, it's only to trigger the Global Path Injector pluggin). This should be pretty easy for anyone to replicate on their own.

https://user-images.githubusercontent.com/39000688/123944073-6dce4d00-d9a5-11eb-9356-4783fe256199.mp4
I added a video about my situation. I have a global planner plugin that I developed myself. I can share a ready path as global_path. After a while from the start, the teb goes directly to the final destination. When I run the same build with dwa, the Robot follows the line without any problems. How can I solve this problem with Teb?

If you would like a more robust way and less hacky way to use TEB Planner to execute a pre-planned path, you can check out Move Base Flex, it provides a more granular API on top of the normal Move Base node.


[WIP] Seeing if I can improve lag in mobile_vr

My first attempt at doing some very simple predictive logic to ensure the image rendered better matches up with where the players head is at when the image becomes visible. Simply taking the average frame timing (time between process and submit) over the last 5 frames and using the last gyro reading to make a guestimate how much further the headset will have rotated by the time the rendered image is made visible.
I have not fully tested this yet because I'm currently at a place where i can't try out my headset.

Fixed errors in the code and it seems to do what its supposed to, but this is not an improvement (yet). The orientation we're getting from the sensors is already lagging a few frames behind so while the code that advances the rotation based on the average frame timing works, it just ends up applying an outdated rotation.
Need to find out more about this...


Example of TensorRT-LLM Whisper backend for PyTriton

Describe the solution you'd like
With the recent TensorRT-LLM support for Whipser, and now that PyTriton supports TensorRT-LLM, would be great to get examples of efficient client and server code, as well as decoupled mode examples.
Describe alternatives you've considered
I've experimented with WhisperS2T coupled with FastAPI and PyTriton, and both perform well. It would be great to get a more involved example, like here and here.

Integrating support for Whisper using TensorRT-LLM with PyTriton for speech-to-text is an exciting challenge. However, PyTriton doesn't currently support streaming directly. For streaming audio, we might need a different setup, but PyTriton can still be a big part of the solution, especially for batch processing, which is more efficient than handling one piece at a time.
Since PyTriton excels in handling text generation but not so much with streaming audio like in a phone call, here's a simplified plan to make the most out of PyTriton for speech-to-text processing:

Create a Streaming Server: First, we need a server that collects audio from users. It waits until it has enough audio to make a full segment that's ready for processing.

Use PyTriton for Processing: Once we have a complete audio piece, we send it over to PyTriton. Here, the Whisper model, supercharged with TensorRT-LLM, kicks in to convert the speech into text. The goal is to take advantage of TensorRT-LLM’s speed and efficiency.

Get the Results Back to the User: After PyTriton does its magic, it sends the text back to the streaming server, which then sends it back to the user. We aim to keep this process quick to ensure users aren’t left waiting.

For this setup to work really well, especially in real-world scenarios, we might need to get a bit clever with how we handle the audio. Instead of sending everything we get straight away, implementing a system to detect when someone has stopped speaking can help us make sure we're only sending complete thoughts to PyTriton. This avoids cutting off sentences and improves accuracy.
To make this solution as good as it can be, knowing more about the kinds of conversations it'll be used for, the quality of audio we're expecting, and how people typically speak in these scenarios would be super helpful.
To refine the example further and ensure it aligns closely with practical deployment scenarios, additional details would be helpful:

Utterance Length Variability: Information on the expected range of utterance lengths and the variability of pause durations between utterances would assist in fine-tuning the pause detection algorithm.

Audio Quality and Format Considerations: Details on the expected audio quality and formats would guide the setup of audio preprocessing steps necessary before inference.

Real-World Use Case Scenarios: Understanding specific use cases, such as dictation, conversation transcription, or command and control applications, would help in tailoring the example to meet the needs of those scenarios.

Would you like to provide more details on these aspects to further refine the proposed solution and tailor it to your specific requirements?

Thanks for the detailed reply. It's definitely a fun challenge. I made an interim solution with our current API server, wordcab-transcribe, by integrating WhisperS2T as a whisper "engine". I'd mostly be interested in a batch/async setup with dynamic batching. Basically a server that's able to gracefully handle lots of incoming requests asynchronously. From what I understand this is already possible, if we're not considering streaming.

@aleksandr-smechov  https://github.com/k2-fsa/sherpa/tree/master/triton/whisper Have you tried this triton python_backend + whisper trt-llm?
If @piotrm-nvidia would like to accept PR, I'd love to prepare a pytriton whisper tensorrt-llm recipe under pytriton/example.

@yuekaizhang Hey Yuekai, definitely familiar with your work. Yes, I've tried this, but eventually integrated WhisperS2T's version into our current API server, wordcab-transcribe since this is more flexible for us. This works well, but I'm still exploring the performance boost PyTriton could have over our current solution. Would be awesome to see what you have in mind with the PR.

@yuekaizhang, thank you for your proposal.
While I recognize the potential value of integrating your Whisper example with the PyTriton repository, there are some complexities related to the additional dependencies and components it requires. For inclusion in the PyTriton examples, we strive for configurations that can be easily set up with minimal environment adjustments. A criterion for acceptance is the ability to manage dependencies via pip install in nvcr.io/nvidia/pytorch or similar image without the need to construct a new Docker image.
If your implementation aligns with these guidelines, I'd be more than happy to consider it. Here’s how we manage our testing for new examples:

Each example should have include a METADATA variable in test.py within its test suite, specifying the Docker image used during testing. You can see an example here: Link to METADATA example.

Our CI executes a test.sh script for each example, which handles installations and environment setup via pip. The script should not require any steps that can’t be automated or require manual intervention. Refer to our existing script structure here for guidance: Link to test.sh example.


docs: there were errors in the documented example

the example logic was not functional.

Pull Request Test Coverage Report for Build 79

0 of 0 (NaN%) changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 75:
0.0%

Covered Lines:
35

Relevant Lines:
35

💛  - Coveralls

@bcoe - this example works great, but should we also tell folks to run nyc report (or nyc report --reporter=html) to create a coverage report in their coverage folder? It might just be me (since I don't use NYC) but I wasn't sure what to do with the output JSON so the result doesn't necessarily look impressive, and might be confusing to folks who just use Istanbul "out of the box".


Broken style of elements in Chrome using CDN

Describe the bug
There is an error to render NES-CSS elements using the latest CDN on Google Chrome. The left side of the elements are not well rendered.
To Reproduce
Steps to reproduce the behaviour:

Go to Satoshis.Games
View the elements. Buttons and NES - elements
See error

Expected behaviour
Clean elements without resulting in a visual error on the left side of the element.
Screenshots

Environment:

Browser: Google Chrome. On safari works great. Firefox/Opera not tested.
Build environment (i.e. NodeJS): NodeJS

Suggestion(s) for fixing this issue
It probably is a compiling issue regarding Chrome

Maybe ref #271, #244. I will try to reproduce later, because at first the buttons that I'm seeing in Satoshis.Games are fine, but I haven't found those bugs from your screenshots yet.

I have updated to the latest version and tested locally.
It seems like the browser was zoomed at 90%, and this caused the issue.

Are you the owner of this website?

Yeah 👍


Add capacity constraint to RuntimeConfig

Do it!

As per discussion with Louis following things were to be included with this :

add store parameter to CacheEventNotificationListenerServiceProvider
add validations to updateResourcePools() (for negative values, new tier, disk size less than heap size if both defined with ENTRIES)
add listener to heap so updateResourcePools() for heap is functional
add resourcePoolType to events generated from updateResourcePools()
find a way to allow ehcache to register itself to the store listener if possible. Else leave a comment about the setSource method workaround in CacheEventNotificationService interface

•	create a ResourcePoolMerger which merges all validated ResourcePool(s) and returns a resourcePools object

PR #408 has been merged.
However, the code as it stands silently applies a heap mutation with a MemoryUnit taking the size and interpreting is as a count based change. This should be fixed to consider this task closed. I would simply refuse it at the validation.


audit: check patch sha matches when --online

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[x] Have you written new tests for your changes? Here's an example.
[x] Have you successfully run brew tests with your changes locally?

See Homebrew/homebrew-core#5353 for motivation.

brew fetch -s may already do this. If so, I think this is already covered by the test-bot? If not: that'd be the best place to add it. Thanks for jumping on this anyway, though!

I can't figure out what -s does, but fetch does seem to do this, so no point duplicating it here.
I think there is some value to having a command that would check this for all formulae like brew audit does though. This would let people find problems and fix them in bulk before they affected anyone. So a way to bulk fetch all formulae?

Sorry, -s is --build-from-source's alias.
Could see an argument for a brew fetch --force --all but that's going to do all tarballs and patches too which I'm not sure will scale well.

which I'm not sure will scale well.

Good point. I do think it would be a good idea to have some way of identifying broken formulae because resources have changed, but I don't know how to go about this, so I'll close this.


Can't pass the test even when the answer is correct

Challenge Record Collection has an issue.
User Agent is: Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36.
Issue Description

can't pass even when the answer is correct
Browser Information

Browser Name, Version: 52.0.2743.116 m
Operating System: window 10 home single language
Mobile, Desktop, or Tablet: Desktop

My code:

// Setup
var collection = {
    "2548": {
      "album": "Slippery When Wet",
      "artist": "Bon Jovi",
      "tracks": [
        "Let It Rock",
        "You Give Love a Bad Name"
      ]
    },
    "2468": {
      "album": "1999",
      "artist": "Prince",
      "tracks": [
        "1999",
        "Little Red Corvette"
      ]
    },
    "1245": {
      "artist": "Robert Palmer",
      "tracks": [ ]
    },
    "5439": {
      "album": "ABBA Gold"
    }
};
// Keep a copy of the collection for tests
var collectionCopy = JSON.parse(JSON.stringify(collection));

// Only change code below this line
function updateRecords(id, prop, value) {

  if( value === "") {
    delete collection[id][prop];
  }

  if(collection[id].hasOwnProperty(prop) === true && value !== "") {
    collection[id][prop].push(value);
  }

  if(collection[id].hasOwnProperty(prop) === false && value !== "") {
    collection[id][prop]=[];
    collection[id][prop].push(value);
  }

  return collection;
}

// Alter values below to test your code
updateRecords(5439, "artist", "ABBA");

Hi @manusia123, thanks for reporting but unfortunately your code is not quite correct yet (not all properties of the objects have array values).
Remember to first visit the HelpJavaScript chat when you're stuck writing code for the algorithm challenges, before raising an issue to report that there is a bug.
Happy coding!


Slow build time

Perhaps a make file would help mitigate this since we wouldn't have to rebuild everything.

Hey @filfat ,
Now all example projects have CMake files.
Regards,
Leonid


defragmentation rule not working properly

I have set up a defragmentation rule: dbSizeInUse / dbSize < 0.5.
Based on the etcd database size, none of the endpoints should be defragmented.
Endpoints rule calculation:
https://<IP_ADDRESS>:2379: 48812032 (dbSizeInUse) / 48812032 (dbSize) = 1
https://<IP_ADDRESS>:2379: 48799744 (dbSizeInUse) / 48799744 (dbSize) = 1
https://<IP_ADDRESS>:2379: 48803840 (dbSizeInUse) / 48807936 (dbSize) = 0,99991
But for some reason defragmentation was executed anyway.
etcd-defrag execution example:
Validating configuration.
 I also tried dbSizeInUse / dbSize * 100 < 50, but it did not work as expected, probably for the same reason you mentioned. I'll let you decide whether this issue should be closed or should stay open.

Thanks for the confirmation. Let's close this ticket


sidebar example is broken

I think it's the only one not working due to a dated openlayers js and css reference (v4.6.4 against v5.1.3) in the html example. Will try to fix it with a PR when I can if you want.

Thanks, what issue are you seeing? I tested in FF, Chrome and Edge prior to merging.

I've made a simple PR to fix this. Cheers!


Add support for CSS's @import

Add support for CSS's @import

This issue was imported from Google Moderator
Moderator votes: +4
Issue added by The Suspect on 2015-01-04
To vote this issue up or down, simply include +1 or -1 in your comment.

+1

+1

+1

+1

+1

+1

I'll see if I can figure out what's needed to do this. Support seems pretty universal now, but that's what I just tried going to CIU to confirm and couldn't.

Now available at https://caniuse.com/#feat=mdn-css_at-rules_import


All containers should have memory limits

All containers should have memory limits in order to prevent denial of service due to a container consuming all of the host's memory. As a best practice, all the containers should have memory limits specified in the deployment spec.
I check the code, there are default values before. But they are commented right now. I am not sure what is the reason?
https://github.com/istio/istio/blob/master/install/kubernetes/helm/istio/values.yaml#L350:L355
We have some default resource requests and limits for telemetry and zipkin. we do not have for others.
Any thoughts? @linsun @morvencao @sdake

@mandarjog can you comment on why this is commented out now?
cc @duderino @jnativio

I don't think the default limits were ever enabled. The default value for requests (10m) are basically just to enable HPA. Some components now have defined requests and limits for both cpu and memory in their own charts (telemetry, istio-proxy). The fact is whatever values are defined by default, the user should review and change them to values compatible to the cluster/nodes size they are installing into.

Not sure why it was commented out, but it is not recent. https://github.com/istio/istio/commit/e5a09e9da2b2a43a34e3d9ba50f6fcea4c403341 @ymesika
We should set limits though.

@clyang82 can you submit a PR for this?  Maybe too late for 1.1, but we can get it in 1.1.1.

The intention of the PR that added the default resources was to enable HPA. And for that you needs to set requested resources for all containers.
What values will you put for the limits? Shouldn't it be tailored for each component?

@linsun @ymesika Just revert the default value to
  defaultResources:
    requests:
      cpu: 10m
      memory: 128Mi
    limits:
      cpu: 100m
      memory: 128Mi

or do you have new suggested values? Thanks

This is for all control plane components' default, correct?
@mandarjog @jnativio do you have recommendations?

Just using these default values are not a good solution. Pilot for instance has a memory requests of 2G in its chart but no limits, so using the default of 128M for limits  is not going to work. Prometheus is another component that uses a good deal of memory. Telemetry and the gateways (when PR #12315 is merged) have limits defined. Probably other components can have a common set of values.

Setting the default global resource limits is risky.
It's will be convincing if we have sufficient perf test data to support those settings.

@clyang82 is this still an issue?  I think we have set mem and cpu limits in 1.1

This is still an issue in 1.1. I see Requests and Limits are set on the istio-proxy containers only.

I am confused about this. I updated to 1.1.3 by the istio-demo.yaml, but when I applied this yaml to k8s , the pilot, the ingressgateway, and the egressgateway were all restarted constantly because the OOMKilled, then I found that they are all set to a smaller limit，so I had to delete the limit，and now everything is fine. So I want to know why set such a small limit?

I agree with @morvencao @zqzzq.
With istio1.1.3, use the isito-demo.yaml with default value, and OOMKilled...

Yes. I think we should have some best practices for supporting the limits for each component. otherwise, it is risky here. if we do not have that data, we can leave it to the user who can modify the values.yaml to set the proper values to fit for their environment.

pilot、policy、telemetry were all restarted continually in 1.1.3 beacuse the  OOMKilled

reset milestone as 1.1 is no more :)


Failed to execute 'stop' on 'AudioScheduledSourceNode': cannot call stop without calling start first.

Wavesurfer.js version(s):
wavesurfer.js 2.0.6 (Fri Jun 15 2018 10:57:58 GMT+0200 (CEST))
Browser version(s):
Google Chrome: 69.0.3497.100 (Official Build) (64-bit)
Code that causes the issue:
    /**
     * Pauses the loaded audio.
     */

}, {
    key: 'pause',
    value: function pause() {
        this.scheduledPause = null;

        this.startPosition += this.getPlayedTime();
        this.source && this.source.stop(0);

        this.setState(PAUSED);

        this.fireEvent('pause');
    }

-A check is needed before executing this.source && this.source.stop(0);, because due to timing problems it might happen that the audio is not started when the stop is called.

To reproduce the issue, you need to load new audio files, then quickly start and stop them.

@antalagota92 thanks for the report. Can you make a pull request?

no feedback, closing.

any update on this issue?

this is still an issue

this is still an issue @thijstriemstra

can you include the wavesurfer.js version/browser/os @Nadav42?

can you include the wavesurfer.js version/browser/os @Nadav42?

windows 10 chrome 64bit version 86.0.4240.111
wavesurfer 4.1.1
it happens when calling wavesurfer.pause()
wouldn't adding that check fix this issue? @thijstriemstra

A pull request is always welcome @Nadav42. That fix looks fine.

@thijstriemstra okay, I'll try it and if it fixes it I'll open a pull request

hey @thijstriemstra I can't find a way to actually check if the SourceNode started or not
what's intresting is that even when I'm checking if wavesurfer is actually playing before pausing there are still some exceptions:
if (wavesurfer.isPlaying()) {
    wavesurfer.pause(); // DOMException: Failed to execute 'stop' on 'AudioScheduledSourceNode' ...
}

I even added the same check inside wavesurfer's webaudio.js like this and it still throws the exception:
if (!this.isPaused()) {
    this.source && this.source.stop(0); // DOMException: Failed to execute 'stop' on 'AudioScheduledSourceNode' ...
}

I'm thinking that maybe this is a rare situation where you call .pause() and even tho the internal state changed to PLAYING by .play() the source buffer didn't start yet because it has small delay?
play code:
this.source.start(0, start);
this.resumeAudioContext();
this.setState(PLAYING);

--> .play()
--> .pause() is called --> exception
--> browser only starts source buffer here on a later timeframe?

anyway adding these checks and also try catch inside wavesurfer's pause() stopped my app from crashing, will you accept a pull request that just adds try catch?

![image](https://user-images.githubusercontent.com/48027340/97222793-8b746280-17d7-11eb-8559-1ed832a276bf.png)


fix: remote config validation not working

Description
Fixes the failing validation by selecting the node, enovy and haproxy by their labels instead of names

Closes #947

this worked fine when I already had the current context set correctly (other than some of the prompt issues):
kind delete cluster -n solo
kind create cluster -n solo
rm -Rf ~/.solo
solo init
solo context connect -n jeromy-solo --context kind-solo --cluster-name kind-solo
solo deployment create -n jeromy-solo --deployment-clusters kind-solo --context-cluster kind-solo=kind-solo
solo node keys --gossip-keys --tls-keys -i node1
solo cluster setup -d /Users/user/source/solo-charts/charts
solo network deploy -n jeromy-solo -i node1 -d /Users/user/source/solo-charts/charts
solo node setup  -n jeromy-solo -i node1
solo node start  -n jeromy-solo -i node1


Added Functions.ConvertPlayerCharacterToRig(player, rigType)

Proposed plan Rig Conversion Commands

Apparently there's conflicts...

Going to not merge this for now. I'll just manually add the function in. Dunno why it's complaining.

Added manually due to "conflicts" and not wanting to mess something up. I'm closing this but note that it was actually merged.


[CI] Only enforce x lints on rust files

There is no reasons we would enforce these lints to non-rust files.

So what do you mean on all files? We probably don't care about .png, .md, etc right?

All text files, so non-binary ones. Maybe we can look at the output of git ls-files --eol for that info?

looking at the lints:
    license::has_license_header,
    whitespace::has_newline_at_eof,
    whitespace::has_trailing_whitespace

these should not apply to markdown files for example.

This is an ok workaround for now, we'll need to think about a better, longer term solution in the future though.
@bors-libra r+

:pushpin: Commit b493148 has been approved by bmwill

:hourglass: Testing commit b493148068e83f3bfbd9fbeb1000f92f7587fb0c with merge 4218fd29a0690c34a7390714b5236ebd290ac4d7...

:sunny: Test successful - checks-circle_commit_workflow
Approved by: bmwill
Pushing 4218fd29a0690c34a7390714b5236ebd290ac4d7 to master...


Update cg-harden-boshrelease to address Bionic CIS Benchmark findings.

In order to meet FedRAMP compliance objectives, we want to close all findings from Nessus CIS benchmark compliance scan, or show that they are operational requirements or false positives.
At this point there are about 58 failed checks. When we need to we can use our parse-nessus script to extract the full description of all the fixes.
We will also need to revisit the existing hardening steps and remove obsolete ones.
As we do this work, check in with compliance to update our POA&Ms and Deviation Requests to remove obsolete entries and put new POA&Ms and Deviation Requests on track to the JAB. We may want to iterate through on subsystems until we're complete.
Acceptance Criteria

[ ] A nessus output that is as clean a practicable
[ ] A cg-harden-boshrelease that is cleared of obsolete entries
[ ] An updated POA&M Tracker with new entries added and closed ones moved and documented
[ ] An updated Deviation Request tracker.
[ ] Shipped updated SSP that address Bionic specifies whether we're using CIS L1 or L2, and that updates subsystems that may have changed (chrony instead of ntpd, for example?)

Security considerations
This nominally improves security but each check & correction will need careful review to ensure that we're not interfering with core functionality.
Implementation sketch

I inadvertently included CIS Level 1 and CIS Level 2 checks in our scans. Per FedRAMP guidance for CM-6 and CM-7, we're only obliged to meet the Level 1 standards. I've updated the scan configuration and the scans this week will reflect the correct scope,

Using the Filter: "Audit File" CONTAINS "L1" shows we only have 23 findings, so that's progress.

Ran new scans and eliminated 2 findings by making sure the AC-8 check was looking for the right languages.
I've pulled together a summary of the open findings


Documentation out of date for FieldValidationInfo

Initial Checks

[X] I confirm that I'm using Pydantic V2

Description
In the documentation at https://docs.pydantic.dev/2.0/usage/validators/#validation-context
there seems to be a class that has disappeared, namely, FieldValidationInfo and now it's just called ValidationInfo
Example Code
No response
Python, Pydantic & OS Version
pydantic version: 2.5.1
        pydantic-core version: 2.14.3
          pydantic-core build: profile=release pgo=true
                 install path: ..../venv/lib/python3.11/site-packages/pydantic
               python version: 3.11.1 (main, Jan 17 2023, 22:23:12) [Clang 13.0.0 (clang-13<IP_ADDRESS>)]
                     platform: macOS-13.2.1-arm64-arm-64bit
             related packages: typing_extensions-4.8.0 mypy-1.1.1

It was updated on latest docs: https://docs.pydantic.dev/dev/concepts/validators/#validation-context (you are using 2.0)

It was updated on latest docs: https://docs.pydantic.dev/dev/concepts/validators/#validation-context (you are using 2.0)

Thank you for reply. Could you please elaborate?


[FLINK-18452][table-runtime-blink] Fix StateMigrationException because RetractableTopNFunction#ComparatorWrapper might be incompatible

What is the purpose of the change
TopN query may throw StateMigrationException because the RetractableTopNFunction#ComparatorWrapper in serializer might be incompatible. The reason lays in ComparatorWrapper compares the generated code, however code might be differnet when generated in different client.
Brief change log

Fix ComparatorWrapper to compare meta information which is used to generate the code. And rename it to ComparableRecordComparator.

Verifying this change
The test is hard to add. We cover this by using ComparableRecordComparator in harness unit test.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@leonardBang , could you help to review this?

Thanks @leonardBang .
Will merge it.


SVN authentication support

Can you add official svn authentication support to application?
I can't find an easy way to pass svn_username and svn_password to application's deploy_revision resource.

i have this problem too. is there a solution for that?

The new version of the application cookbook supports using any resource for file distribution so you can use the normal svn resource.


Bump identity framework version 5.23.1

$subject

will merge this once the framework got released


Make BaseURL Private

same as commit histories

https://github.com/kw-notice/kw-notice-ios-v1/issues/51


test:Extend Integration Tests to cover multiple files transfer

WHAT
This PR enhances the integration testing framework by introducing a wider scenarios for transferring multiple files across different cloud storage technologies. The objective is to reinforce the coverage and reliability of file transfer functionalities, ensuring they perform seamlessly across various platforms.
WHY
The necessity to augment the integration tests to cover multifile transfers files stems the crucial role of robustness in the software's functionality. During the development phase, it was encountered two distinct issues that compromised the integrity of multiple file transfers:

S3 to Azure multiple file transfers fails when blobName property is present:
It was discovered a flaw during the transfer of multiple files from Amazon S3 to Microsoft Azure. The integration test transferFile_s3ToAzureMultipleFiles_whenConsumerDefinesBlobName_success failed when it should have succeeded. This is due to the addition of the blobName property in the destination message. The Azure technology project, uses a transfer method that  assume a singular file transfer when this property is present, leading to the unintended overwriting of files at the destination.
Here is the  code.

Azure transfer key retrieval using different strategies:
Another non standard behavior emerged when Azure served as the source for multiple file transfers. The method listContainerFolder  makes use of a different authentication strategy, it does not use the already resolved secret key. This method tries to resolve the key again using a hard coded alias, composed by account name with the posfix "key-1"
Here is the code for listContainerFolder  and here the authentication method that is used.

Closes #1090

Hi @zub4t
can you please rebase this PR with main, i will run again the CI then
Thanks

Hi @zub4t
can you please rebase this PR with main, i will run again the CI then
Thanks

Done 😎

@zub4t
all tests are green now, can you pls check only the formatting?
you can run it locally with ./gradlew checkstyleMain checkstyleTest checkstyleTestFixtures
Then we can merge it, Thanks

@zub4t
all tests are green now, can you pls check only the formatting?
you can run it locally with ./gradlew checkstyleMain checkstyleTest checkstyleTestFixtures
Then we can merge it, Thanks

I'm sorry I didn't do it sooner. But now everything is as it should be.


Failed to verify JWT - reintroduced....

Hey,
When migrating from cloud-sdk 2.1.0 to 2.3.0, the following issue occurs, which is kind of related to #2211:
I'm trying to execute a VDM request via a destination. The destination is determined via @sap-cloud-sdk/connectivitys getDestination function provided with a JWT issued via @sap/xssecs requests.requestClientCredentialsToken for the destination service...
As worked out in #2211 and meanwhile documented in the migration guide, I've set iasToXsuaaTokenExchange to false.
Working with<EMAIL_ADDRESS>everything's fine, but breaks when using<EMAIL_ADDRESS>(or above) with the stack trace listed below.
The other cloud sdk libs can be used eiter in 2.1.0/2.2.0/2.3.0, only the connectivity module causes the issue.
Stack trace:
[cds] - ErrorWithCause: Failed to verify JWT.
    at /path/to/project/node_modules/@sap-cloud-sdk/connectivity/src/scp-cf/jwt.ts:118:13
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at Function.getSubscriberToken (/path/to/project/node_modules/@sap-cloud-sdk/connectivity/src/scp-cf/destination/destination-from-service.ts:159:20)
    at Function.getDestinationFromDestinationService (/path/to/project/node_modules/@sap-cloud-sdk/connectivity/src/scp-cf/destination/destination-from-service.ts:94:7)
    ... // my user code....
Caused by:
Error: Jwt token with audience: [
  'sb-clonexxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx!byyyy|my-xsappname!bzzz',
  'uaa'
] is not issued for these clientIds: [ 'sb-myapp!txxxx', 'myapp!txxxx' ].
    at returnError (/path/to/project/node_modules/@sap/xssec/lib/validator.js:254:25)
    at /path/to/project/node_modules/@sap/xssec/lib/validator.js:306:36
    at TokenInfo.<anonymous> (/path/to/project/node_modules/@sap/xssec/lib/tokeninfo.js:140:24)
    at /path/to/project/node_modules/jsonwebtoken/verify.js:223:12
    at /path/to/project/node_modules/@sap/xssec/lib/verificationkey.js:111:24
    at KeyCache.getKey (/path/to/project/node_modules/@sap/xssec/lib/keycache.js:191:16)
    at VerificationKey.loadKeyXSUAA (/path/to/project/node_modules/@sap/xssec/lib/verificationkey.js:104:18)
    at Object.module.exports [as verify] (/path/to/project/node_modules/jsonwebtoken/verify.js:94:10)
    at TokenInfo.verify (/path/to/project/node_modules/@sap/xssec/lib/tokeninfo.js:128:20)
    at /path/to/project/node_modules/@sap/xssec/lib/validator.js:269:30 {
  cause: Error: Jwt token with audience: [
    'sb-clonexxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx!byyyy|my-xsappname!bzzz',
    'uaa'
  ] is not issued for these clientIds: [ 'sb-myapp!txxxx', 'myapp!txxxx' ].
      at returnError (/path/to/project/node_modules/@sap/xssec/lib/validator.js:254:25)
      at /path/to/project/node_modules/@sap/xssec/lib/validator.js:306:36
      at TokenInfo.<anonymous> (/path/to/project/node_modules/@sap/xssec/lib/tokeninfo.js:140:24)
      at /path/to/project/node_modules/jsonwebtoken/verify.js:223:12
      at /path/to/project/node_modules/@sap/xssec/lib/verificationkey.js:111:24
      at KeyCache.getKey (/path/to/project/node_modules/@sap/xssec/lib/keycache.js:191:16)
      at VerificationKey.loadKeyXSUAA (/path/to/project/node_modules/@sap/xssec/lib/verificationkey.js:104:18)
      at Object.module.exports [as verify] (/path/to/project/node_modules/jsonwebtoken/verify.js:94:10)
      at TokenInfo.verify (/path/to/project/node_modules/@sap/xssec/lib/tokeninfo.js:128:20)
      at /path/to/project/node_modules/@sap/xssec/lib/validator.js:269:30 {
    statuscode: 401
  }

Btw, I do not provide a custom issuer via iss property...
Do you have any suggestions on what needs to be changed when upgrading?
Thanks in advance,
Tobi

Hello Tobi,
we reproduced the timeline of events:

16.2 Bump version of XSSEC to version 3.2.13
17.1 Release SDK version 2.1.0 (still working)
28.2 Use xssec also for validation of token
6.4 Release SDK version 2.2.0 -> error appears

So the error is related to XSSEC checking more than we did before. Our old custom implementation only got the certificate and checked that the signature matched. No check on audience. The library now checks that the audience meet some conditions which is not the case.
I have access to the internal code base and see many tests and there are many conditions on the audience, scopes and clientIds. I am no expert there but I would assume they know what they are doing :-). I would recommend to things:

Try to create a JWT for the XSUAA service. This is just an idea but it feels more correct since the XSUAA is the entry point and tokens will be cast to the service token later down the flow anyway. We have a convinience method for that:
serviceToken('xsuaa')
If you do not provide a JWT at all, the SDK will request a JWT for the destination service. It will use the clientId and secret from vcap and as a tenant the provider account where the application is currently running. This token is not validated because we got it from the XSUAA and it is valid. So perhaps this could be a solution, or could you perhaps explain why you need to create a JWT manually?

Best
Frank

Hi Frank,
since I'm dealing with a multitenant environment, the second option is not an option for me.
Before upgrading, I fetched the destination token for the current tenant via
requests.requestClientCredentialsToken(tenant, getDestinationServiceCredentials(), null, (err, token) => resolve(token)) where requests is part of @sap/xssec.
In order to get a tenant-specific JWT via the serviceToken function, I already need a JWT as far as I can see.
Is there no other way to get a JWT on behalf of a certain tenant as it is for the requestClientCredentials function mentioned above?
BR
Tobi

Let me ask a little different:
Is the following (which in fact works and corresponds in a way to what is also mentioned in the migration guide) a suitable way to go:
const token: string = await serviceToken('xsuaa', {jwt: {iss: https://${tenant}.localhost:8080/uaa/oauth/token}, useCache: true}); ?

I think you could just pass a json object with {iss:'',zid:''} to the serviceToken method since it doe not really do much with the token.
I also wonder if the creation of a JWT for Tenant A and then passing it in does and validating it does something from a security point of view. You potentially could just hand in Tenant A in the issuer object.
Nevertheless the creation and validation of a JWT should off course work when the right audiences is theres which potentially is the case for a JWT issued for the XSUAA. When I look at the test in the lib it looks like all app names and client IDs are collected and matched against the audiences:
it('ClientId matches token audience without dot', function (done) {
            var token = new Token(["client", "foreignclient", "sb-test4!t1.data.x"]);

            // configures audience validator with client-id from VCAP_SERVICES
            var result = new JwtAudienceValidator("sb-test4!t1").validateToken(token.aud);

            assert(result.isValid()); // should match

            done();
        });

So I guess you can also play around with the requestClientCredentialsToken and serviceToken and see with audience are created.

Let me ask a little different:
Is the following (which in fact works and corresponds in a way to what is also mentioned in the migration guide) a suitable way to go:
const token: string = await serviceToken('xsuaa', {jwt: {iss: https://${tenant}.localhost:8080/uaa/oauth/token}, useCache: true}); ?

If this leads to a token which can be validated by the lib and you get the destination for the tenant later on, yes. However as I mentioned above this does not add value (not 100% sure there) compared to using the {iss:...} directly in the JWT because you create a token and validate it directly. You still need to ensure that the value for tenant is not manipulated by someone. If you have a JWT issued coming from outside of your application this is can not happen

Thanks for your input, Frank!
That has helped a lot.


results with inScope: true (ie AZURE_SEARCH_ENABLE_IN_DOMAIN) cannot be trusted

I seems to me that using inScope parameter of the AzureCognitiveSearch extension does not seem to work well enough to be useful.
Bad responses include:

generated text (similar to gpt with no extensions) with no reference citations (i.e. not limited to my data)
generated text with reference citations that demonstrably do not contain the stated "fact" (i.e. hallucination, not finding the correct part of my data)
generated text with correct citations but the information presented is from unrelated parts of the reference (and hence incorrect) (i.e. not  "understanding" my data)

I do understand that this is a hard problem, but presented as it is - a flag you can turn on with no further information about what it's doing or much ability to configure it, I think we can be forgiven for assuming that someone somewhere has signed off on it as "looks good to me" and that it should mostly work (this is preview stuff in the end...)
Where can we get more details on the implementation of the AzureCognitiveSearch extension, and how (if even possible) to tune it? There is some cool automagic going on there somewhere, but we need to be able to look behind the curtain a bit if we are going to be building on top of the work you have done on the platform. Particularly when some feature doesn't quite "just work"
Thanks.

Hi @getpointful , we have documentation for using data with Azure OpenAI, including the inScope parameter, here: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#limit-responses-to-your-data.

Limit responses to your data
This option encourages the model to respond using your data only, and is selected by default. If you unselect this option, the model may more readily apply its internal knowledge to respond. Determine the correct selection based on your use case and scenario.

If you have specific quality concerns and would be comfortable sharing details about your data and scenario, please open a support ticket with Azure OpenAI service.


Pin to latest sqlite3

Opening this as a discussion piece I guess.
Something is odd in the management of the sqlite3 project. Mapbox seem to all but have abandoned it, but at the same time, there have been a slew of little security fixes made on the main branch - but no releases are being cut, despite people clamoring for it for many months.
This PR pins to the latest HEAD commit. It addresses a number of security issues that arrive through node-gyp and tar. Drawback being, we won't easily notice when/if the actual 5.0.3 or whatnot gets published.
Note that this does NOT update the dep in create-app for now.
I'm thinking that this is the lesser evil among the choices we have.

I wonder if it make sense for us to pick up and own this work in Knex to move to better-sqlite? https://github.com/knex/knex/issues/4511

Yeah, let's close this and look at the alternative package instead!

@benjdlambert Considering that development on a new knex dialect for better-sqlite seems to have gone silent, would be awesome if your team could pick that up.

@kibertoad I'd be happy to try and give it a shot - do you have any useful documentation links about adding a new driver that you think might be helpful to get started with?

@benjdlambert I don't think there is much documentation on that available. My recommendation would be to:

Create new directory in https://github.com/knex/knex/tree/master/lib/dialects;
Make new dialect extend sqlite3 dialect (see mysql2 for a good example of a dialect that is 99% same);
Override whatever methods are specific to sqlite3 within new dialect;
Update https://github.com/knex/knex/blob/master/.github/workflows/integration-tests.yml and https://github.com/knex/knex/blob/master/.github/workflows/coverage.yml to test new dialect;
Update https://github.com/knex/knex/blob/master/test/util/db-helpers.js and https://github.com/knex/knex/blob/master/test/integration2/util/knex-instance-provider.js.


test: Cleanup multiplexed_integration_test.cc

Inline multiplexed_integration_test.h into multiplexed_integration_test.cc
Rename Http2IntegrationTest to MultiplexedIntegrationTest and
rename Http2RingHashIntegrationTest to MultiplexedRingHashIntegrationTest
and make both also cover HTTP/3.
Reorder the tests so that the various tests are contiguous instead of interspersed through the file.
Signed-off-by: Ryan Hamilton<EMAIL_ADDRESS>Risk Level: N/A
Testing: N/A
Docs Changes: N/A
Release Notes: N/A
Platform Specific Features: N/A

/assign @alyssawilk

@alyssawilk this file was a bit of a jumble and this PR cleans it up. It does move a bunch of tests around the the PR is a tad messy, but I think it's worth it?

I'm fine with inlining but I don't think the reordering is worth it.  having tests contiguous is nice but IMO not worth losing the git history.
/wait

I'm fine with inlining but I don't think the reordering is worth it. having tests contiguous is nice but IMO not worth losing the git history. /wait

Ok, un-moved. The file has only existed since April and is test-only so it doesn't have a ton of history in it. It's also about 2000 lines with 4 somewhat unrelated test fixtures (multiplexed integration, ring hash, http2 frames, http2 metadata). I wonder if it might makes sense to split these into different test.cc files in a follow up?


Sony A6000 - Open Memories does not recognise my camera

Hi there,
I am trying to download the app onto my camera and i have downloaded the sony plugin i have also downloaded the pmca-gui-v0.17-osx to my laptop [a mac] and no matter what i do, i keep getting the same error shown in the image.

hed image.
I have tried doing it from a different laptop, also changing the cable. I dont know what im doing wrong.

As stated in the FAQs, please install the driver loader application. You might also have more luck switching the camera to MTP mode in the setup menu.


It does not get the end of the translated file, IndexError: list index out of range

Everything was okay, in last 500 character it pasted original text and translation shown there were no problem at all but srtranslator gave that error, everything was ok according to ur conditions.
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/toprak/.local/lib/python3.10/site-packages/srtranslator/__main__.py", line 81, in <module>
    srt.translate(translator, args.src_lang, args.dest_lang)
  File "/home/toprak/.local/lib/python3.10/site-packages/srtranslator/srt_file.py", line 145, in translate
    subs_slice[i].content = translation[i]
IndexError: list index out of range

Could you hand me the subtitle file? I can't replicate. Ty

@sinedie here

Can't replicate, sry. I could do an improved error handling tho.
Already uploaded to PyPi.

that would be good at least we could find a way, thanks what should I do close this or?

still no updates?

@toprak No luck, can't replicate :/

@sinedie even though u could not replicate, let it open maybe someone would

@sinedie I asked chatgpt to help :D maybe it would help
It seems like you're encountering an "IndexError: list index out of range" error in the code for the srtranslator library. This error is raised when you're trying to access an element in a list using an index that's out of the range of the list.

In the code provided, it looks like the error is occurring in the following line:

css
Copy code
subs_slice[i].content = translation[i]
This error is likely being caused because the length of the translation list is different from the length of the subs_slice list. To resolve this issue, you should check the lengths of both lists before performing this operation and make sure that they're the same. You could do this by adding the following code before the operation:

scss
Copy code
if len(translation) != len(subs_slice):
    raise IndexError("Translation and subs slice lists have different lengths.")
This will raise an error with a more descriptive message, which will help you understand what's going wrong in the code.

Hey, yeah, I know where should be the error but for the script to know if the translation is done the number of sentences should be equal in source and destination. Look this on line 104 : https://github.com/sinedie/SRTranslator/blob/84cad275b1472a08d905a9907e623ff707ed44af/srtranslator/translators/deepl.py#L100-L106
So, if a subtitle has 10 dialogs, it translate 10 dialogs, but somehow you are getting more?? Again, couldn't reproduce even with your example :/
Maybe you could add some prints statements to check what response are you getting?

@sinedie i lost the subtitle if you have can you send me? also dunno how to add some print statements

@toprak Don't have it anymore :/.
It keeps being an issue with other ones that you had translated?

@sinedie it just was happening on that series weirdly iirc, I formatted my pc I will be at home like 2 days later so will test it on another series :(


Handle tuple deserialization in deserialize_any properly

Fixes #121
Needs some more tests before merging. I'm not happy about all the lookahead that this requires, but I don't see a better solution.

Okay, let's see if bors works now.
bors try

Okay, now only one issue remains: The conversion from a serialized tuple to a Value loses the tuple information (it becomes a sequence). That's because Serde's data model doesn't differentiate between those two.

Thank you for the review!
bors r+

Sure!

Done ;)


[Icon Request] Support for csscomb

[x] I'm sure this issue is not a duplicate.
[x] I'm submitting an icon request:

Type: filename
Icon Name: csscomb
Sample original Icon:
Filenames: .csscomb, .csscomb.json

There is a csscomb vscode extension at marketplace but not sure what data should be provided as extension, shall it be .csscomb and .csscomb.json? @JimiC

vscode-ccscomb is just a Formatter extension that uses csscomb (proof: https://github.com/mrmlnc/vscode-csscomb/blob/master/package.json#L107).
What the OP wants is to associate the configuration filename with an icon.
From what I'm seeing in the docs and in the code is that only .csscomb.json is a valid configuration filename, unless @muuvmuuv can point us to docs or code that says otherwise.

@JimiC yep sorry, only .csscomb.json. I used .csscomb with a custom path in the csscomb config.

I made a simpler icon based on the provided image since there isn't any svg file available and making one from that would require too many gradients!

SVG code:
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 32 32"><defs><linearGradient id="a" x1="11.64" y1="11.617" x2="20.589" y2="20.567" gradientUnits="userSpaceOnUse"><stop offset="0" stop-color="#de9b48"/><stop offset="1" stop-color="#8e3f25"/></linearGradient></defs><title>file_type_csscomb</title><path d="M29.35,11.756c-.2.223-.41.444-.6.653-1.706-1.7-3.373-3.35-5.041-5.005l-.132.11c.<IP_ADDRESS>1.325.393q2.067,2.136,4.141,4.264c.308.314.387.586-.042.916Q25.184,10.4,22.377,7.71l-.146.124a3.252,3.252,0,0,0,.264.359Q24.82,10.6,27.154,13c.288.294.428.558.009.947l-5.64-5.387-.171.164c.156.168.308.34.468.5q2.255,2.328,4.511,4.651c.282.291.454.57-.039.9l-5.6-5.358-.148.125a3.99,3.99,0,0,0,.315.422c1.5,1.553,3.013,3.1,4.513,4.6<IP_ADDRESS>2.448.277.854a1.077,1.077,0,0,1-.2.155l-5.611-5.369-.153.137c.<IP_ADDRESS>6.369.445q2.249,2.331,4.5,4.658c.<IP_ADDRESS>.178.194a5.771,5.771,0,0,1,.054.632c-.175-.054-.4-.057-.52-.17-1.375-1.3-2.734-2.617-4.1-3.927-.392-.377-.791-.745-1.187-1.118l-.138.115a3.766,3.766,0,0,0,.3.4q2.3,2.388,4.618,4.767c.274.281.482.554-.008.929l-5.63-5.372-.159.15c.<IP_ADDRESS>5.577.629q2.214,2.292,4.431,4.579c.29.3.349.563-.081.852l-5.6-5.362-.145.128c.145.177.279.364.437.529q2.265,2.352,4.54,4.7c.271.279.34.536-.063.86l-5.621-5.367-.146.139c.<IP_ADDRESS>9.306.375q2.34,2.43,4.687,4.853c.3.311.335.558-.079.848l-5.615-5.366-.154.139c.<IP_ADDRESS>.379.441q2.286,2.37,4.579,4.732c.295.3.412.574-.046.894l-5.613-5.365-.147.131c.<IP_ADDRESS>4.369.454q2.289,2.366,4.586,4.724c.289.3.426.581-.038.907l-5.621-5.37-.14.118a3.221,3.221,0,0,0,.269.371q2.325,2.406,4.658,4.8c.279.287.458.571-.018.92l-5.61-5.371-.135.109a4.038,4.038,0,0,0,.333.451q2.3,2.394,4.609,4.777c.276.284.381.553-.034.891l-5.621-5.376-.135.1a2.749,2.749,0,0,0,.254.37q2.3,2.392,4.609,4.778c.<IP_ADDRESS>.218.228a3.344,3.344,0,0,1,0,.584c-.161-.042-.37-.034-.476-.134-1.57-1.484-3.125-2.984-4.686-4.478-.209-.2-.428-.391-.643-.586l-.126.117c.134.165.2<IP_ADDRESS>3q2.249,2.332,4.5,4.659c.4.416.395.572-.037.9L10.507,19.58l-.139.117a4.724,4.724,0,0,0,.352.462q2.217,2.289,4.441,4.569c.545.562.549.624.087,1.043L9.653,20.407l-.146.122a3.6,3.6,0,0,0,.3.415q2.326,2.406,4.663,4.8c.282.289.382.551-.062.876L8.8,21.252l-.139.109a1.6,1.6,0,0,0,.184.3q2.36,2.448,4.727,4.888c.274.283.489.555-.009.923L7.951,22.1l-.137.108a3.36,3.36,0,0,0,.291.4q2.3,2.391,4.617,4.772c.284.293.518.577-.017.924L7.149,22.994l-.094.091c.588.59,1.171,1.185,1.763,1.77,1.08,1.068,2.157,2.137,3.251,3.189.366.352.391.652-.007.975-.069.056-.131.121-.2.183-1.124,1.059-1.568,1.059-2.7-.018-.427-.406-.848-.819-1.247-1.252a2.4,2.4,0,0,0-2.407-1.019,1.239,1.239,0,0,1-.021-.343,1.542,1.542,0,0,0-.481-1.508C4.48,24.483,3.9,23.949,3.37,23.369c-.085-.093-.166-.19-.245-.289C1.93,21.713,2,21.307,2,21.307L21.09,2.167c.663-.665,2.063.725,2.954,1.77a.89.89,0,0,1,.295.242A2.493,2.493,0,0,0,26.748,5.3c.<IP_ADDRESS>.1.129-.2,1.01.411,1.625,1.057,2.245A19.189,19.189,0,0,1,29.452,9.3,1.568,1.568,0,0,1,29.35,11.756Z" style="fill:url(#a)"/></svg>

LGTM and as it's a filename icon, 3.1KiB is a good size for it.


Fix deployment cleanup if more than 1000 objects

Trying to delete more than 1000 objects was causing a Malformed XML error, so now we issue multiple deleteObject requests if necessary.

@mramato Fixed!


filter a rdd of archive records, and save a new warc file

Is it possible to filter a RDD of a archive records, and save it back to an archive?
Something like:
ArchiveSpark.load(sc, WarcHdfsSpec("/cdx/path/*.cdx", "/path/to/warc/and/arc"))
.filter(r => domain(r.url) = "epfl.ch")
.save(sc, WarcHdfsOut("/tmp/filtered.xdc", "/tmp/filtered.warc"))

Hi David and thanks for the suggestions, we've considered this already and it is actually fairly easy to implement, it's just a matter of time. However, now as there is actually demand, I'll try to add this feature as soon as possible. I'll keep you posted!

Hi helgeho, I've created a gist using the warcbase library. You might adapt it to ArchiveSpark:
https://gist.github.com/dportabella/3caf261c218a4448a03a14dbc06fe730

Hi David,
I have great news for you, we just pushed ArchiveSpark 2.5 and (besides many bug fixes) it now has support for this:
After loading a CDX/WARC dataset, you can now filter / select the records and save them as new WARC(.gz) files with custom headers and even generate corresponding CDX records for it.
If you have imported de.l3s.archivespark.specific.warc._ in your code, you can now call saveAsWarc on your dataset, with the following signature:
cdxWarcRDD.saveAsWarc(path: String, info: WarcMeta, generateCdx: Boolean = true)

WarcMeta is a case class that lets you specify some metadata for your new WARC files, i.e.,:
val meta = WarcMeta(publisher = "Your Name")

More detailed instruction will follow soon...
Hope this helps!

that's great news, thx! :)


feat(audio): implement MKL-accelerated speech-to-text for Mac

/claim #318
Fixes: #318

@onyedikachi-david plz do not touch benchmark stuff
mkl should not be default feature
and release-app.yml should work with mkl feature on windows and linux

cehck this to run actions locally https://github.com/nektos/act

cehck this to run actions locally https://github.com/nektos/act

I am unable to get this work; I am using this command, but it errors
Command: act -W .github/workflows/release-app.yml --container-architecture linux/amd64 -j publish-tauri --pull
Error:
Details

act -W .github/workflows/release-app.yml --container-architecture linux/amd64 -j publish-tauri --pull
INFO[0000] Using docker host 'unix:///var/run/docker.sock', and daemon socket 'unix:///var/run/docker.sock'
[Release App/draft] 🚀  Start image=catthehacker/ubuntu:act-latest
[Release App/draft]   🐳  docker pull image=catthehacker/ubuntu:act-latest platform=linux/amd64 username= forcePull=true
[Release App/draft]   🐳  docker create image=catthehacker/ubuntu:act-latest platform=linux/amd64 entrypoint=["tail" "-f" "/dev/null"] cmd=[] network="host"
[Release App/draft]   🐳  docker run image=catthehacker/ubuntu:act-latest platform=linux/amd64 entrypoint=["tail" "-f" "/dev/null"] cmd=[] network="host"
[Release App/draft]   🐳  docker exec cmd=[node --no-warnings -e console.log(process.execPath)] user= workdir=
[Release App/draft]   ☁  git clone 'https://github.com/crabnebula-dev/cloud-release' # ref=v0
[Release App/draft] ⭐ Run Pre create draft release
[Release App/draft]   ☁  git clone 'https://github.com/actions/cache' # ref=v4
[Release App/draft]   ☁  git clone 'https://github.com/actions/cache' # ref=v4
[Release App/draft]   ✅  Success - Pre create draft release
[Release App/draft] ⭐ Run Main actions/checkout@v4
[Release App/draft]   🐳  docker cp src=/Users/onyedikachi/Documents/codes/algora-bounties/screenpipe/. dst=/Users/onyedikachi/Documents/codes/algora-bounties/screenpipe
[Release App/draft]   ✅  Success - Main actions/checkout@v4
[Release App/draft] ⭐ Run Main create draft release
[Release App/draft]   🐳  docker cp src=/Users/onyedikachi/.cache/act/crabnebula-dev-cloud-release@v0/ dst=/var/run/act/actions/crabnebula-dev-cloud-release@v0/
[Release App/draft] ⭐ Run Main Get current date
[Release App/draft]   🐳  docker exec cmd=[bash --noprofile --norc -e -o pipefail /var/run/act/workflow/1-composite-0.sh] user= workdir=
[Release App/draft]   ✅  Success - Main Get current date
[Release App/draft]   ⚙  ::set-env:: CURRENT_DATE=2024-09-17
[Release App/draft] ⭐ Run Main Cache CLI
[Release App/draft]   🐳  docker cp src=/Users/onyedikachi/.cache/act/actions-cache-restore@v4/ dst=/var/run/act/actions/actions-cache-restore@v4/
[Release App/draft]   🐳  docker exec cmd=[/opt/acttoolcache/node/18.20.4/x64/bin/node<EMAIL_ADDRESS>user= workdir=
[Release App/draft]   💬  ::debug::Resolved Keys:
[Release App/draft]   💬  ::debug::["Linux-ARM64-cn-2024-09-17"]
[Release App/draft]   💬  ::debug::Checking zstd --quiet --version
[Release App/draft]   💬  ::debug::1.4.8
[Release App/draft]   💬  ::debug::zstd version: 1.4.8
[Release App/draft]   💬  ::debug::Resource Url: http://<IP_ADDRESS>:54797/_apis/artifactcache/cache?keys=Linux-ARM64-cn-2024-09-17&version=f3ff9bf2703664aec57193db3d61fb84cea1a68e5dbfa0f54a0c7cdd8e7164b6
[Release App/draft]   ⚙  ***
[Release App/draft]   💬  ::debug::Cache Result:
[Release App/draft]   💬  ::debug::{"archiveLocation":"***","cacheKey":"linux-arm64-cn-2024-09-17","result":"hit"}
[Release App/draft]   💬  ::debug::Archive Path: /tmp/43517925-207a-466a-9973-300605775203/cache.tzst
[Release App/draft]   💬  ::debug::Use Azure SDK: false
[Release App/draft]   💬  ::debug::Download concurrency: 8
[Release App/draft]   💬  ::debug::Request timeout (ms): 30000
[Release App/draft]   💬  ::debug::Cache segment download timeout mins env var: undefined
[Release App/draft]   💬  ::debug::Segment download timeout (ms): 600000
[Release App/draft]   💬  ::debug::Lookup only: false
| Cache Size: ~1 MB (1367415 B)
| [command]/usr/bin/tar -xf /tmp/43517925-207a-466a-9973-300605775203/cache.tzst -P -C /Users/onyedikachi/Documents/codes/algora-bounties/screenpipe --use-compress-program unzstd
| Cache restored successfully
| Cache restored from key: linux-arm64-cn-2024-09-17
[Release App/draft]   ✅  Success - Main Cache CLI
[Release App/draft]   ⚙  ::set-output:: cache-primary-key=Linux-ARM64-cn-2024-09-17
[Release App/draft]   ⚙  ::set-output:: cache-matched-key=linux-arm64-cn-2024-09-17
[Release App/draft]   ⚙  ::set-output:: cache-hit=true
[Release App/draft] ⭐ Run Main actions/cache/save@v4
[Release App/draft]   🐳  docker cp src=/Users/onyedikachi/.cache/act/actions-cache-save@v4/ dst=/var/run/act/actions/actions-cache-save@v4/
[Release App/draft]   🐳  docker exec cmd=[/opt/acttoolcache/node/18.20.4/x64/bin/node<EMAIL_ADDRESS>user= workdir=
[Release App/draft]   💬  ::debug::Checking zstd --quiet --version
[Release App/draft]   💬  ::debug::1.4.8
[Release App/draft]   💬  ::debug::zstd version: 1.4.8
[Release App/draft]   💬  ::debug::implicitDescendants 'false'
[Release App/draft]   💬  ::debug::followSymbolicLinks 'true'
[Release App/draft]   💬  ::debug::implicitDescendants 'false'
[Release App/draft]   💬  ::debug::omitBrokenSymbolicLinks 'true'
[Release App/draft]   💬  ::debug::Search path '/Users/onyedikachi/Documents/codes/algora-bounties/screenpipe/cn'
[Release App/draft]   💬  ::debug::Matched: cn
[Release App/draft]   💬  ::debug::Cache Paths:
[Release App/draft]   💬  ::debug::["cn"]
[Release App/draft]   💬  ::debug::Archive Path: /tmp/61da6c1d-bbe6-4575-8c1b-3000628bf274/cache.tzst
| [command]/usr/bin/tar --posix -cf cache.tzst --exclude cache.tzst -P -C /Users/onyedikachi/Documents/codes/algora-bounties/screenpipe --files-from manifest.txt --use-compress-program zstdmt
[Release App/draft]   💬  ::debug::File Size: 1367413
[Release App/draft]   💬  ::debug::Reserving Cache
[Release App/draft]   💬  ::debug::Resource Url: http://<IP_ADDRESS>:54797/_apis/artifactcache/caches
[Release App/draft]   💬  ::debug::Saving Cache (ID: 11)
[Release App/draft]   💬  ::debug::Upload cache
[Release App/draft]   💬  ::debug::Resource Url: http://<IP_ADDRESS>:54797/_apis/artifactcache/caches/11
[Release App/draft]   💬  ::debug::Upload concurrency: 4
[Release App/draft]   💬  ::debug::Upload chunk size: 33554432
[Release App/draft]   💬  ::debug::Awaiting all uploads
[Release App/draft]   💬  ::debug::Uploading chunk of size 1367413 bytes at offset 0 with content range: bytes 0-1367412/*
[Release App/draft]   💬  ::debug::Commiting cache
| Cache Size: ~1 MB (1367413 B)
[Release App/draft]   💬  ::debug::Resource Url: http://<IP_ADDRESS>:54797/_apis/artifactcache/caches/11
| Cache saved successfully
| Cache saved with key: Linux-ARM64-cn-2024-09-17
[Release App/draft]   ✅  Success - Main actions/cache/save@v4
[Release App/draft] ⭐ Run Main Run Command
[Release App/draft]   🐳  docker exec cmd=[bash --noprofile --norc -e -o pipefail /var/run/act/workflow/1-composite-run-command.sh] user= workdir=.
| /var/run/act/workflow/1-composite-run-command.sh: line 4: ././cn: No such file or directory
[Release App/draft]   ❌  Failure - Main Run Command
[Release App/draft] exitcode '127': command not found, please refer to https://github.com/nektos/act/issues/107 for more information
[Release App/draft]   ⚙  ::set-output:: stdout=
[Release App/draft]   ❌  Failure - Main create draft release
[Release App/draft] exitcode '127': command not found, please refer to https://github.com/nektos/act/issues/107 for more information
[Release App/draft] ⭐ Run Post create draft release
[Release App/draft]   🐳  docker cp src=/Users/onyedikachi/.cache/act/crabnebula-dev-cloud-release@v0/ dst=/var/run/act/actions/crabnebula-dev-cloud-release@v0/
[Release App/draft]   ✅  Success - Post create draft release
[Release App/draft] 🏁  Job failed
Error: Job 'draft' failed

this does not work - closing


minor code fix to upgrade pyo3 to 0.16.5

I'm not sure if this is done correctly, but it seems to work (passes cargo test, cargo bench).
It seems the way a method gets called has changed.

Thanks @chetmurthy for this bump!


👷 Build universal binary when release

Build universal binary when released. So the scripts can be simplified.

Hey @moonfruit :)
Good idea. Do you maybe know if the universal binary needs to be notarized again?

I tried lipo to combine the two binaries that dart built. But it did not run correctly. I have no idea how to solve this, so I close this pr. Sorry!!

No problem, I'll dig into it once I have some time.


Har to JMX converter

Hi,
I am successfully generate the .Har file through BrowserMob but when I try to convert har to JMX using blazemeter then it's showing me error.
It works when I generate the .Har file through charles proxy.
Can you please let me know there is any way to convert .Har file to Jmx with using Browsermob.
Thanks.

HAR->JMX isn't supported. I don't see why it shouldn't work, but since it doesn't, I'd welcome a PR to fix whatever the issue is.


Typo URL in v1.25.0+k3s1 release notes

There appears to be a small typo in the v1.25.0+k3s1 release notes.
One of the bullet points has this:

See the docs for their replacement.

The text "the docs" points to:
https://k3s-io.github.io/docs/docs/reference/server-config#deprecated-options
but I think the correct link should be:
https://k3s-io.github.io/docs/reference/server-config#deprecated-options

Thanks for the note. The docs have been in a bit of a state of flux as we transition over to the new platform. I'll update the notes.

Yeah this was on me for updating the gh-pages repos, apologies