Added document explorer custom QA logic to the samples.

Issue #, if available:
https://github.com/aws-samples/generative-ai-cdk-constructs-samples/issues/93
Description of changes:
Created a variant of the Document Explorer sample that passes custom Lambda code to the aws-qa-appsync-opensearch. The custom lambda allows the QA construct to process a list of multiple documents. The custom lambda code resides inside the lib/lambda directory.
Summarization and Visual Q&A logic was not changed.
In addition to the custom lambda code, the StreamLit client app was updated to display multiple document selection.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

QQ: do you have by any chance a list of changes that you added to this sample vs the base doc explorer ? Maybe the PR could be a subfolder with those changes and guidance in the main repo, as it would avoid the code duplication (additional maintenance)

QQ: do you have by any chance a list of changes that you added to this sample vs the base doc explorer ? Maybe the PR could be a subfolder with those changes and guidance in the main repo, as it would avoid the code duplication (additional maintenance)

This may be suitable as a subfolder, though it requires small changes across the API Stack, importing the custom lambda code, and modifying the StreamLit app. Not sure the best way to do it would be. Would simply adding this change to the Document Explorer sample be an option?
Most of the diff shows as macro level file adds / deletions due to the changes to the directory structure, but here are the highlights:

API Stack Change: samples/document-explorer-custom-qa/lib/api-stack.ts Line 265: Added custom code to QaAppsyncOpensearch construct props.
Gen AI QA Construct Lambda Logic copy: samples/document-explorer-custom-qa/lib/lambda/aws-qa-appsync-opensearch-custom/*: Added (copied) lambda code from the QaAppsyncOpensearch default execution lambda.
Lambda file that was changed: samples/document-explorer-custom-qa/lib/lambda/aws-qa-appsync-opensearch-custom/question_answering/src/qa_agent/doc_qa.py Line 154: Contains the logic changes in the construct lambda to allow filtering of multiple documents.
StreamLit modifications: samples/document-explorer-custom-qa/client_app/pages/*: Updates to the Streamlit app to allow the front end to work with multiple document selections.

QQ: do you have by any chance a list of changes that you added to this sample vs the base doc explorer ? Maybe the PR could be a subfolder with those changes and guidance in the main repo, as it would avoid the code duplication (additional maintenance)

This may be suitable as a subfolder, though it requires small changes across the API Stack, importing the custom lambda code, and modifying the StreamLit app. Not sure the best way to do it would be. Would simply adding this change to the Document Explorer sample be an option?
Most of the diff shows as macro level file adds / deletions due to the changes to the directory structure, but here are the highlights:

API Stack Change: samples/document-explorer-custom-qa/lib/api-stack.ts Line 265: Added custom code to QaAppsyncOpensearch construct props.
Gen AI QA Construct Lambda Logic copy: samples/document-explorer-custom-qa/lib/lambda/aws-qa-appsync-opensearch-custom/*: Added (copied) lambda code from the QaAppsyncOpensearch default execution lambda.
Lambda file that was changed: samples/document-explorer-custom-qa/lib/lambda/aws-qa-appsync-opensearch-custom/question_answering/src/qa_agent/doc_qa.py Line 154: Contains the logic changes in the construct lambda to allow filtering of multiple documents.
StreamLit modifications: samples/document-explorer-custom-qa/client_app/pages/*: Updates to the Streamlit app to allow the front end to work with multiple document selections.

Thanks @ScopatGames ! Yes I think having it as a "guidance" in the doc explorer would be a better solution than a second doc_explorer. Maybe add a subfolder with a README explaining the changes to provide, and the lambda code you added there as well

As discussed, closing this PR as another will be opened to have changes as a guidance under the original document explorer sample. Thanks @ScopatGames !


Improve docs

Description

Fixed a couple typos across many docs
Improved styles

Better usage of headings
Main description works without <br/>, allowing to render ``` properly (e.g. Camera.md)

Reworked StyleSheet.md – it had a lot of examples from v7 which I dropped to have a cleaner explanation of the current state. If still somebody has to migrate the differences should be pretty obvious.

Checklist

[ ] I have tested this on a device/simulator for each compatible OS
[x] I updated the documentation with running yarn generate in the root folder
[ ] I mentioned this change in CHANGELOG.md
[ ] I updated the typings files (index.d.ts)
[ ] I added/ updated a sample (/example)

Also improve installation guides to fix #2168.

Also improve installation guides to fix #2168.

Let's not fix that, as I'm not sure if that bug report is legit or not.

It's legit, just confirmed. expo install can't use a git source. Produces "undefined": "rnmapbox/maps#main in the package.json.
It was already mentioned in the guide but the example was actually using expo install rnmapbox/maps#main.

Thank you for your time, I think I've resolved the issues.

👍 thanks much!


:art: Sugar syntax to verify if CharsetMatches contain at least one entry

+ refresh url characters freq from simia.net
before
results = from_bytes(...)

if len(results):
    ...

after
results = from_bytes(...)

if results:
    ...

Codecov Report

Merging #91 (0942d52) into master (3e653a3) will decrease coverage by 0.05%.
The diff coverage is 50.00%.

@@            Coverage Diff             @@
##           master      #91      +/-   ##
==========================================
- Coverage   85.08%   85.02%   -0.06%
==========================================
  Files          11       11
  Lines        1173     1175       +2
==========================================
+ Hits          998      999       +1
- Misses        175      176       +1

Impacted Files
Coverage Δ

charset_normalizer/models.py
85.64% <50.00%> (-0.37%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3e653a3...0942d52. Read the comment docs.


Blade templates broken when data comes from generator

Laravel Version: 5.5.37
PHP Version: 7.1.6
Database Driver & Version: MySQL 5.6.35

Description:
The changes introduced in https://github.com/laravel/framework/pull/23388 break templates that loop over generators:
Exception(code: 0): Cannot traverse an already closed generator at ...

Steps To Reproduce:
In your view composer, or wherever the data for your view is prepared:
while ($someCondition) {
    ...
    yield $results;
}

In your view:
@foreach ($results as $chunk)   <<< This line throws the exception
    @foreach ($chunk as $record)
        ...
    @endforeach
@endforeach

The offending line looks like this in the compiled template:
<?php $__currentLoopData = $results; $__env->addLoop($__currentLoopData); foreach($__currentLoopData as $chunk): $__env->incrementLoopIndices(); $loop = $__env->getLastLoop(); ?>

This can be easily reproduced in a fresh Laravel project:
-- routes/web.php

Route::get('results', function () {
    return view('results');
});

-- app/Results.php

class Results
{
    public function generate()
    {
        for ($count = 1; $count < 10; $count ++) {
            yield ['a', 'b', 'c'];
        }
    }
}

-- resources/views/results.blade.php

@inject('results', 'App\Results')

@foreach($results->generate() as $chunks)
    <div>
        @foreach($chunks as $chunk)
            {{ $chunk }}
        @endforeach
    </div>
@endforeach

Using Laravel 5.5.36 you get the expected result:
a b c
a b c
a b c
a b c
a b c
a b c
a b c
a b c
a b c

Using any version after merging https://github.com/laravel/framework/pull/23388 results in:
Cannot traverse an already closed generator (View: my-project/resources/views/results.blade.php)

It should be reverted until it provides a solution that doesn't break basic PHP functionality.


Implement a new Redis sink

This PR implements a new sink type: Redis (https://redis.io).

looks good - thanks! :)

Do I need something else to merge this PR:grey_question:

@jippi this is now "rebased" with the latest changes from master.


Test: Load CAs from OS for http2 requests in the extension host

Refs: #185098

[ ] macOS @connor4312
[x] linux @sbatten
[x] windows @TylerLeonhardt

Complexity: 3
Create Issue

Create a local certificate:

openssl req -x509 -newkey rsa:4096 -keyout server_localhost_key.pem -out server_localhost_crt.pem -days 365 -nodes -subj /CN=localhost

Install the certificate in the OS.

Windows: Manage Computer Certificates > Trusted Root Certification Authorities
Mac: Keychain Access > System > Certificates
Linux: Distro dependent. Ubuntu: https://ubuntu.com/server/docs/security-trust-store

Run an HTTP2 server using the certificate:

const http2 = require('http2');
const fs = require('fs');

const options = {
  key: fs.readFileSync('./server_localhost_key.pem'),
  cert: fs.readFileSync('./server_localhost_crt.pem')
};

const server = http2.createSecureServer(options);

server.on('error', (error) => {
  console.error(error);
});

server.on('stream', (stream, headers) => {
  stream.respond({
    'content-type': 'text/plain',
    ':status': 200
  });
  stream.end('Hello, HTTP2 world!');
});

server.listen(3000);

Install the "Network Proxy Test" extension: https://marketplace.visualstudio.com/items?itemName=chrmarti.network-proxy-test
Run the Network Proxy Test: Test Network Connection (HTTP2) command entering https://localhost:3000 and verify there is no "self signed certificate" error in the output.

For future reference, https://github.com/FiloSottile/mkcert is a wonderful tool :)


fix: change token validity for invalid cert

Description
A small description of what you did in that PR.

Gravitee.io Automatic Deployment
🚀 A prerelease version of this package has been published on Gravitee's private artifactory, you can:

use it directly by updating your project with version: 1.0.0-apim-3985-mtls-security-plan-fix-error-invalid-cert-SNAPSHOT
download it from Artifactory here

:tada: This PR is included in version 1.0.0-alpha.3 :tada:
The release is available on:

1.0.0-alpha.3
GitHub release

Your semantic-release bot :package::rocket:


Fix incorrect cast after json_decode

Force array cast in sample labels
Fixes https://github.com/Jimdo/prometheus_client_php/issues/45

Encountered this problem today too.
Ubuntu 14.04 LTS
PHP 7.0 with phpredis


Prepare for making snippets testable

Toward a real fix for #1786 and related issues (usage docs out-of-sync with API surface).

LGTM


One Data factory with 2 git repositories

Hi,
i am planning to deploy One data factory with 2 projects using 2 github repositories. is it possible to use like this.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7309c102-934f-e073-823d-684804e38ff9
Version Independent ID: 2035c3ea-1e64-4f1b-0194-c1b407812e28
Content: Source control - Azure Data Factory
Content Source: articles/data-factory/source-control.md
Service: data-factory
GitHub Login: @djpmsft
Microsoft Alias: daperlov

@nareshynn Thanks for your question. Please provide us with the link to the documentation you are referring to so we can better assist.

@nareshynn Using GitHub integration, you can switch to a different Git repo.
For more details, refer "ADF - Switch to a different Git repo".
Hope this helps.

@nareshynn If you are using two different projects with 2 separate git repositories, I would highly recommend creating two separate factories. Is there a reason this isn't possible?

@nareshynn  We will now proceed to close this thread. If there are further questions regarding this matter, please comment and we will gladly continue the discussion.


[APIM 4.2.0] Disabling 'apim.lambda_mediator_config' Configuration

Description
Hi Team,
We have concerns with AWS Lambda integration in APIM 4.2.0. Firstly, we have noticed the absence of the following 'apim.lambda_mediator_config' configuration, which they previously used in APIM 3.2.0 to manage the passing of request parameters to AWS Lambda backend.
[apim.lambda_mediator_config]
pass_request_params = false

But In APIM 4.2.0, the lambda_headers (path, query, and header) are enabled by default. Is there a method to disable them using the aforementioned configuration or any alternative configuration options? Upon inspecting the api-manager.xml.j2 file, I observed that the mentioned configuration is no longer present in APIM 4.2.0. Could you please confirm if there are alternative configurations or methods available for disabling these headers?
Best regards,
Hamool
Affected Component
APIM
Version
4.2.0
Environment Details (with versions)
APIM 4.2.0
Related Issues
No response
Suggested Labels
No response

Public fix: https://github.com/wso2/carbon-apimgt/pull/10694


chore: more documentation

Contributor checklist

[ ] Bug fixes include regression tests
[ ] Features include unit/acceptance tests

Pull Request Test Coverage Report for Build 068bc08328a363f773e1cb94f94fcf84878f3d6b-PR-7

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 39.209%

Totals

Change from base Build 652ad320df6815f04afc56fbaced1761fe685d31:
0.0%

Covered Lines:
436

Relevant Lines:
1112

💛  - Coveralls


How to create multi projects when deploy in local?

How to create multiple projects, such as theworkspace function, when deploying locally?

@chenshen03 Workspaces are available in Enterprise edition only.


Need overriding rules for AFD caching for max-age values

[Rules that override maxAge values are not clarified correctly in the page. For example, if the response headers to Azure Front Door has maxAge=0 although AFD is set to cache static resources with maxAge=86400s, does AFD override the 0 value to 86400 or keeps the value it received in the cache-control response headers. This is also not clear in the Azure Portal as well.]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 2973ab88-1258-8a80-1344-07a9e0063951
Version Independent ID: c0cff4d9-d7fd-7b25-52da-9cbe5dda3ba8
Content: Azure Front Door - caching
Content Source: articles/frontdoor/front-door-caching.md
Service: frontdoor
GitHub Login: @duongau
Microsoft Alias: duau

@jyotirmoypan
Thanks for your feedback! We will investigate and update as appropriate.

@jyotirmoypan ,
This will depend on the Cache Behavior option selected in the Rules engine rule.

So, for example, in your scenario above if the Cache Behavior option is set to Override always then the AFD will overide the max-age value with the duration set in the rule i.e 86400 seconds.
This behavior is documented in this section.

Hope this answers your question. Thank you!

@jyotirmoypan ,
Since we did not hear back from you, we will now proceed to close this issue out. Please tag me in your response if you have any questions. Thank you!


Fix msvc 9 and 10 compile errors

Older Visual Studio C compilers don't know the inline specifier and need variables declared at the beginning of blocks.

Thanks @cgohlke!
@ev-br this PR is against 0.19.x, so leaving it up to you to merge (backport-candidate should be forward-candidate :)).

Merged, thanks Christoph!
Ralf: yeah, I tend to read the label as involves multiple branches in some way :-)

Forward ported in https://github.com/scipy/scipy/pull/7061


fix(builder): use require.resolve to get the path of babel-loader

Types of changes

[x] Bug fix (a non-breaking change which fixes an issue)
[ ] New feature (a non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Description
Yarn sometimes tries to move packages into a subpackage. (yarn moved babel-loader dependency into node_modules/@nuxt/builder-edge/node_modules/babel-loader when upgraded a project) This break builds when resolving webpack loaders because they are being required from root package nuxt builder.
This PR is the same as a workaround for '@nuxtjs/babel-preset-app'/NPX. Only targetting babel loaders as they are more likely to move into the builder.
Checklist:

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly. (PR: #)
[ ] I have added tests to cover my changes (if not applicable, please state why)
[ ] All new and existing tests are passing.

Codecov Report

Merging #4150 into dev will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##             dev   #4150   +/-   ##
=====================================
  Coverage   81.8%   81.8%
=====================================
  Files         29      29
  Lines       1561    1561
  Branches     409     409
=====================================
  Hits        1277    1277
  Misses       224     224
  Partials      60      60

Impacted Files
Coverage Δ

packages/builder/src/webpack/base.js
98.41% <ø> (ø)
:arrow_up:

packages/builder/src/webpack/utils/perf-loader.js
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fff7812...8604cf3. Read the comment docs.

This breaks pnpm :cry:


⚠ ClamAV has degraded performance

In 5576a64, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 427 ms

Resolved: ClamAV performance has improved in ba5bf66.


build failed

when I build the code downloaded from GitHub, there comes a error causing building failed:
/apollo/modules/map/relative_map/tools/BUILD:18:1: C++ compilation of rule '//modules/map/relative_map/tools:navigator' failed (Exit 1).
so now , who can give me a hand......

@XiaoHongZuLiao could you give us more details about your system as well as the steps you followed to build Apollo?

Maybe there was something wrong with the zip file which you downloaded or something went wrong when you unzip the source code ...

@natashadsouza well, now it doesnt throw out any exceptions and indicate "build failed" directly...... the steps I followed to build Apollo seems to accuracy, install docker, git clone Apollo, pull down docker images and then step into docker environment, when it come to this step, all things goes well, but when I type in "bash apollo.sh build", the progress runs for little time, and during this period, I found it also downloads something like libs from Internet, after this ,it turns out "build failed". So now, Im considering whether the RAM of my host should be at least 8G, because my host only exist 4G memory.

@Eclipsehelio I think there shouldnt be someting wrong with the zip file I downloaded from github because Ive tried so many times downloading hahaha .... But whether the code needs to be modified should be carefully taken. I have saw one suggestion that before building the project we should change the value of JOB_AGE to 1. Have you ever heard of this?

@natashadsouza  sorry for my late replying!

@ Eclipsehelio sorry for my late replying!

@Eclipsehelio sorry for my late replying!

well, now Im trying to build the apollo project again and failed again.....the information is : INFO: Reading 'startup' options from /apollo/tools/bazel.rc: --batch_cpu_scheduling --host_jvm_args=-XX:-UseParallelGC ERROR: (09-16 15:38:53.089) build interrupted. INFO: (09-16 15:38:53.091) Elapsed time: 359.813s The OS I use this time is ubuntu 16.04, does it matter? Or I need to run it on ubuntu18.04? Ill try it tomorrow!!!!

What a pity! Ive tried about two times where the environment and the hardware all meets the requirements, but it turns out still failed without any hint. I dont know how to go next.

@XiaoHongZuLiao did you upgrade your RAM and try again?

@natashadsouza Yes, of course. I`ve upgrade my RAM to 8G, but failed again , even worse , without any hint.

@XiaoHongZuLiao I would recommend deleting Apollo completely from your system, and starting over. Since we do not have any error messages, it is almost impossible for me to debug unfortunately. Please try to re-clone and build once more and send me a screenshot of the build failure if you see it again.

@natashadsouza All right, I`ll try it again and thank you very much!

@natashadsouza luckily, build successfully, I build the code on cloud platform thus there`s no hardware problem , now how can I run a demo on the dreamview ?

@XiaoHongZuLiao sounds good! Just follow the "How to Build Guide" it will walk you through the process.

@natashadsouza Thank you very much! And may I ask you another question? Do you know where I can get the data of High Definition Map used in Apollo, or I made a mistake, the virtual car run Apollo just use normal guide map we usually use in lives?

@XiaoHongZuLiao you can choose the map once Dreamview is set up. There is a drop down menu to choose whichever HD map you would like to use for your testing purposes. The How to document should walk you through the process. Thanks.

@natashadsouza All right, thanks again!

@natashadsouza luckily, build successfully, I build the code on cloud platform thus there`s no hardware problem , now how can I run a demo on the dreamview ?

@XiaoHongZuLiao, congrats on your build success. I will appreciate if you can give me some hands. I am struggling with alot of bugs at every given steps, I have tried some recommendations yet build has not been successful. By the way, which virtual platform did you use this time? If you don't mind, I can set up a google handout call for few seconds of your time so I can get some guidance from you. Here is my email id<EMAIL_ADDRESS>Thanks for help.


Fix stone rounding issue

Fix rounding issue I inadvertently caused when altering the formatting.

@schellingb could you make a new release with this fixed stone issue please? :)


Add support for typed arrays for empty and isEmpty

Added support for TypedArrays for R.empty which also allowed TypedArrays to work for R.isEmpty.
#2799

Thank you very much @canytra!


Uit in Vlaanderen problems

We got a telephone call from Herzele. Some events do not get in the app. Synchronisation does not work.
eg. Groot Eetfestijn (15-16december) https://www.uitinvlaanderen.be/agenda/e/groot-eetfestijn/e219181e-4935-415e-ada2-666f13e7e1e4
This is not visible in the app.  The event has multiple dates, maybe this is the issue?
When we fixed this problem we have to mail<EMAIL_ADDRESS>

@abom, can you investigate the logs of the nightly sync to see if event e219181e-4935-415e-ada2-666f13e7e1e4 is skipped and why it's skipped? If it's skipped, it's probably because of the starttime
uitdatabank.py:279
    r_timestamps = detail_result["calendar"].get("timestamps")
    if not r_timestamps:
        logging.debug("skipping event because we could not determine starttime for: \n%s",
                      pprint.pformat(detail_result))
        return None

    event_start_dates, event_end_dates = get_event_start_and_end_dates(r_timestamps, v2=uitdatabank_secret)
    if not event_start_dates:
        logging.info("Skipping event because it had no starttime (list) for:\n%s", pprint.pformat(detail_result))
        return None

It's not skipped in the logs, but cannot find why it's not there till now.

The event was imported normally and deleted by hand later.


Update concept-compute-target.md

@SimranArora904 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Hi @SimranArora904 - This pull request was opened in the public repo. PMs should work in the private repo, per the Microsoft Docs contributor guide. It looks like you have worked in the private repo before; would you make this content update in the private repo? Thank you! We'll close this PR.

Can you please guide me on how to make this change from the private repo? Thanks

Hi @SimranArora904 - I've reopened this PR; we can keep it open here for review by the author. I'll send you information via email about working in the private repo. Thanks.

@sdgilley I fixed "don't," and the link and note formatting. It's not clear to me who the "we" is in the note that's added. If it's Microsoft, wouldn't Microsoft be the entity behind the support that's available in Azure Computer?

@ktoliver good point.  The "we" is Azure Machine Learning.

#sign-off


"--less-verbose" option

[x] I'm reporting a feature request
[x] I've verified that I'm running youtube-dl version 2021.12.17
[x] I've searched the bugtracker for similar feature requests including closed ones

I use youtube-dl to download channels and playlists, and everyday I download new videos of those channels/playlists.
So if I run:
youtube-dl https://www.youtube.com/channel/somechannel --no-warnings --download-archive downloaded.txt
Then run a second time:
youtube-dl https://www.youtube.com/channel/somechannel --no-warnings --download-archive downloaded.txt
A lot of the output are lines like:
[youtube:tab] Downloading page X
[download] Downloading video 1 of 595
[download] X1234 has already been recorded in archive
It could be great to have a option "--less-verbose" to output only lines like errors and downloaded videos. "--quiet" shows no output at all. My log are huge, almost impossible to find anything on it.

Redirect the standard output to the bit-bucket:

POSIX: ... >/dev/null
Windows cmd: ... >NUL

Output like
WARNING: Falling back on generic information extractor.
ERROR: Unsupported URL: http://survey-smiles.com/

sent to standard error will still appear.

>/dev/null seems to have the same effect as "-q"
I get errors like:
ERROR: The playlist does not exist.
but not the previous line showing which video/playlist.
Also, getting log of downloaded videos is useful. Getting log of skipped downloads are irrelevant.

Otherwise, pipe the output through grep or awk (POSIX) or findstr (Windows cmd) to strip out the output lines you don't want.
Or fork the code and filter messages in Python: see #31466.

I'll mark this off now. Nonetheless, a well-justified PR might be considered.


reading format 'YYYY-MM-DD hh:mm:ss'

Is it possible for react-BigCalendar to output dateTime Values in the 'YYYY-MM-DD hh:mm:ss' format and to read events specifying their start and end using the same date time format ? I need this because this is the format used by mysql (by default),
Thanks
Jose

RBC itself needs javascript date objects to work on, but you can convert between the string format and a real date however you like. Doing that is more the job of you api fetch and post logic than it is the component here.


Change Reading and Revere municipalities to mail only

Updating a couple PickUpAvailable columns to false per the municipalities' request and this task

Looking at the spreadsheet attached to the Asana task makes me think that Watertown should also be included here. It doesn't appear in the task ACs, however. Could we check with Marissa and Emily about this?

Looking at the spreadsheet attached to the Asana task makes me think that Watertown should also be included here. It doesn't appear in the task ACs, however. Could we check with Marissa and Emily about this?

Flagged for Marissa and Emily in this Asana comment. Will ✅ as-is if they say Watertown still wants in-person pickup.


Question - private_dns_zone_prefix - Locals in connectivity module

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description
Related to Add additional resource types to variable validation #361  & [Variables] template_file_variables
I've chosen not to deploy the connectivity module because the support for Virtual WAN wasn't available back when we started.
We have deployed private DNS zones in a spoke and want to utilize the ES CAF built-in initiative "Deploy-Private-Dns-Zones" but point the private_dns_zone_prefix  to our spoke Vnet.
I've tried to utilize the template variable private_dns_zone_prefix however, it doesn't pick that up. So I went with trying to do some advanced configuration for the connectivity module without deploying any of its resources. But it didn't solve my issue either. It still uses some default values. : "/subscriptions/xxx-xxx-xxx-xxxx/resourceGroups/es-dns/providers/Microsoft.Network/privateDnsZones/
I'm not able to decipher the advanced input for connectivity.
I found that hardcoding the following locals private_dns_zone_prefix solves my problem.
"/subscriptions/xxxx-xxx-xxx-xxxx/resourceGroups/rg-dns-prod/providers/Microsoft.Network/privateDnsZones/"
/modules/connectivity/locals.tf
private_dns_zone_prefix        = "${local.resource_group_config_by_scope_and_location["dns"][local.dns_location].resource_id}/providers/Microsoft.Network/privateDnsZones/"
So my question follows, how would I go about specifying the advanced block to be able to use the actual value for this parameter?
Below is the block I tried. It's somewhat based on #361. I'm by no means a pro at interpreting code 😄
    advanced = {
      custom_settings_by_resource_type = {
        azurerm_private_dns_zone = {
          dns = {
            westeurope = {
              resource_id = var.privateendpoint_resource_base_id
            }
          }
        }
      }
    }

I really appreciate any help you can provide.

Thank you for your question @Schillman
If I have understood correctly, you are trying to ensure that the correct value is parsed into the Deploy-Private-Dns-Zones Policy Assignment without using the module to deploy the DNS zones?
Currently we only create this Policy Assignment on the corp Management Group. Depending on how you are implementing this Policy Assignment, there are a few options for how to overcome this and interestingly we have literally just adde some guidance for this.
We don't quite have it published to the Wiki yet, but please can you check out the content here:
[Examples] Set parameter values for Policy Assignments
This should hopefully give you the guidance you need to set the required parameter values as part of creating a Policy Assignment.
Also a massive thank you to @DevSecNinja who helped with this timely content!!

Just to add, you may or may not be able to use template_file_variables as an alternative to declaring each of the parameters, depending on where you are using this assignment.
In theory, you would add the following to your module declaration to enable this:
module "enterprise_scale" {
  source  = "Azure/caf-enterprise-scale/azurerm"
  version = "2.4.1"

  # additional config and input variables removed for brevity

  template_file_variables = {
    private_dns_zone_prefix = "/subscriptions/xxxx-xxx-xxx-xxxx/resourceGroups/rg-dns-prod/"
  }

}

However this is a "managed Policy Assignment" so the connectivity module will override whatever is being inherited from the template if assigned at the corp scope.

Hi,
First of all, thank you for your answer, and yes, you understood me correctly. Unfortunately, I didn't have time to check this yesterday.
However, Today I tried the above suggestions without success. I even tried the following:
advanced = {
      custom_settings_by_resource_type = {
        azurerm_private_dns_zone = {
          dns = {
            westeurope = {
              resource_id = "/subscriptions/xxxx-xxx-xxx-xxxx/resourceGroups/rg-dns-prod/"
            }
          }
        }
      }
    }

So I created my definition, initiative, and assignment, along with archetype_config and template_file_variables.
"Deploy-Dns-Records": {
          "privatednszoneprefix": "${dns_zone_prefix}"
}

The reason I wanted to utilize the built-in assignment was that I didn't want to have to update our definitions manually. But as a colleague told me, a Private-link resource is not often added.
Again, Thank you for your answer. Greatly appreciate it.

Glad you managed to find a solution to this @Schillman although I'm still not completely sure why you were not able to use assignment. If you think something is missing in the guidance I have shared, please let me know so we can work on improving it for greater clarity.
Also, as an FYI, please see the following issues which may be of interest to you:

https://github.com/Azure/Enterprise-Scale/issues/1097
https://github.com/Azure/Enterprise-Scale/issues/725

This is now being actively worked on so we should be shipping updated policy files for this soon.

Hi @krowlandson,
I'd gladly take a meeting where we can discuss this further. So I would be looking forward to that.
Topics to be discussed:
Our particular problem and the potential solution. But if there already is a way of solving it, then you could probably explain to me how one should go about setting a custom privateDnsZoneId. Then, I could make a draft/PR, for example, using it.


Fix SHOW BACKUP examples

Closes #7963

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/bf94621b08ad35eec05aa92a0487b33d88a1f586/
Edited pages:

v20.1/show-backup.md
v20.2/show-backup.md


Need ability for an organization distribution group to have IOS automatic repovisioning

Describe the solution you'd like
When viewing an IOS application, Appcenter has a great mechanism for Collaborators to have their devices (when registering) to be automatically re provisioned and re-sign my ad-hoc application.
This can be seen under these menus:
App -> Distribute -> Groups -> Collaborators (middle pannel) -> Settings (top right) as seen in the screen shot.

However If you click on a distribution group (made of contributors). You dont get that same option as in the image below:

It tells you to go to the Organizations Group settings for other options but I can not find anything in there that would allow me to auto re-provision a device and re-sign it for a distribution group.
Describe alternatives you've considered
My only alternative is to place everyone into a collaborator group and NOT use distribution groups.
Additional context
Perhaps I am missing something. Please let me know if there are other ways.

@ScottArbeit or @dimazaid
Any thoughts on this? Am I correct in that the only way to have automatic provisioning for an organization is to add them as collaborators and NOT put them into a distribution group?

Hi @GimpMaster,
Thanks for reaching out to us.
Currently AppCenter supports Auto-provisioning for App-specific groups only but not Shared groups in organization.
I guess, the group Quality Assurance is a Shared group in your Organization.
We will investigate more on what it takes to support for shared groups and will update you.
cc @Oddj0b

Hey @GimpMaster, thank you for your suggestion. Initially, we didn't include this scenario because of how you can add testers to a shared distribution group from multiple apps. Is it correct to assume you are not concerned about reaching the 100 device limit on your Apple account?

Thank you @Oddj0b and @Ajaykn21
Here is what I am hoping to achieve and perhaps you can guide me :)
We are a company that develops multiple white labeled apps in both android and IOS. I have my company: Sales, Developers, Q/A all setup in my organization in different shared distribution groups. Our company is less than 25 employees at this time.
When we get a customer's white labeled app to a point we want to test them my hope was to create a new shared distribution group for Company A employees and only share them to their app. Thus when they sign up they would get their device automatically provisioned. I wasn't sure if the 100 person limitation was per app or per ios development team.
Any suggestions?

Hi
I would be interested in this feature too. I have created a group to allow people to install Android or IOS as the users have a variety of unknown devices. Would really like to auto provision anyone who wants to install IOS.

@Oddj0b and @danielmartind
Just commenting back. After doing more research the 100 person per dev team limitation is actually a hard pill to swallow. You can not remove any phone at random from apple. They basically stick onto your account until the anniversary of your initial signup as a dev team with apple.
So you are right that we can't just add and remove customers devices at will. Thus we have changed our operation such that when we do want to show it to a customer outside our internal team we begrudgingly go through Test Flight and have the Apple Gods deem it worthy of a beta test.


Update strip_tags.js to recursively remove tags

[x] Fixes #350

Using strip_tags for real-world html sanitization is vulnerable to circumvention.

Not sure where @kukawski is at with their fix for this issue, but figured I would try my hand at it and submit a PR anyways. :)
Feel free to go ahead and just close this if a better PR is in the works 👍

Thanks!


hide-for-large-up is not working on  <IP_ADDRESS>

For  elements, hide-for-large-up is not working.  Using the css inspector in Chrome, it seems the @media block for min-width: 64.063em is not superceding the @media block for the lower screen sizes.
Therefore, the element gets
    display: table-cell !important;

instead of
    display: none !important;

th.hide-for-large-up and td.hide-for-large-up are still not working on 5.5.2; such elements remain visible in large, xl, and xxl locations. Checked in chrome, ff, and ie11 on Windows 7.

This is resolved in F6. A PR would be merged for this. We'll close this here - thanks!


fix: use crypto and atob/btoa

note: #2 needs to be merged first!

replaces the not random randomstring with the crypto API [which was already used by randombytes], a drawback of this is that it doesn't specify the string length, [is this needed?]
replaces some deps with the built-in atob/btoa which is deprecated in node, but is supported in browsers and is consistent with CF's implementation
drops require making the module itself ESM compliant

Wow, thanks! Will review this asap, see reply Re: #2

The string length doesn’t matter for the session id but we’ll need to confirm the UUIDs comply with the spec requirements for the username frag and password for ICE.

The string length doesn’t matter for the session id but we’ll need to confirm the UUIDs comply with the spec requirements for the username frag and password for ICE.

I didn't test that, didn't think much of it, but that should be looked at considering i havent

Here’s the RFC https://datatracker.ietf.org/doc/html/rfc5245#section-15.4

Here’s the RFC https://datatracker.ietf.org/doc/html/rfc5245#section-15.4

- is rejected, my bad

this is broken, dont merge!

Noticed the package has process again - I think that is an unintentional revert?

Noticed the package has process again - I think that is an unintentional revert?

yes, which is why the > dont merge
sorry

this now works x)

Oh, one thing that may have been missed - I was using random-string not randomstring for the reasons you mentioned (the randombytes dep in particular seemed bad.)
https://github.com/valiton/node-random-string/blob/master/lib/random-string.js
In light of that does this PR still make sense? The actual routine has no dependencies afaik.

Btw that change was made recently so might mean we could drop some of the esbuild browserify bits. I think those get tree shaken out but def worth seeing if that helps to remove the ones not needed by simple-peer.

Oh, one thing that may have been missed - I was using random-string not randomstring for the reasons you mentioned (the randombytes dep in particular seemed bad.)
https://github.com/valiton/node-random-string/blob/master/lib/random-string.js
In light of that does this PR still make sense? The actual routine has no dependencies afaik.

random-string isnt random, simple-peer uses randombytes anyways

Ah ok - so rn this PR drops that dep and improves the security of the ICE creds?
I’m a little worried about randombytes since it drops into an infinite loop if Buffer is not in the global namespace :/ I figured people will have browserify or esbuild packing it but it is quite a gnarly failure mode. (There is a while(true) with a try/catch!)

Any idea when simple-peer calls randombytes? I can dig into it later, just wondering if you knew already.

Not sure if this is helpful, but this is what I used to generate the ufrag and password in my tests:
function gen_random_ice_str(byte_len) {
	const bytes = crypto.getRandomValues(new Uint8Array(byte_len));
	const byte_str = bytes.reduce((accum, v) => accum+String.fromCharCode(v), '');
	return btoa(byte_str).replaceAll('=', '');
}

ICE ufrag is a minimum of 3 bytes of entropy and the ICE password is a minimum of 16 bytes of entropy.  So
const ufrag = gen_random_ice_str(3);
const password = gen_random_ice_str(16)

Any idea when simple-peer calls randombytes? I can dig into it later, just wondering if you knew already.

when generating random id/channel name

’m a little worried about randombytes since it drops into an infinite loop if Buffer is not in the global namespace :/ I figured people will have browserify or esbuild packing it but it is quite a gnarly failure mode. (There is a while(true) with a try/catch!)

yeah this is where I was heading with all my changes, to drop the need to polyfill anything at all :)

Ah cool, yeah it would be ideal to drop them and if not avoid calling into them. We can pass those into simple peer.

And yep that is a good catch @evan-brass - the per character entropy of the current code isn’t the entire byte so my lengths are too conservative.

I think these changes would be good:

fix the entropy issue as per @evan-brass ’s approach

avoid call paths to randombytes by passing in safely generated ids to simple-peer

top comment mentioned something about a require making it a non-esm, didn’t see that come up

remove any unnecessary browserify deps for local esbuild (these still may be necessary due to simple-peer)

avoid call paths to randombytes by passing in safely generated ids to simple-peer

not possible, you'd need to drop simple-peer to do that

Ah I see that the _id can’t be avoided - too bad

	const bytes = crypto.getRandomValues(new Uint8Array(byte_len));
	const byte_str = bytes.reduce((accum, v) => accum+String.fromCharCode(v), '');
	return btoa(byte_str).replaceAll('=', '');

should be done

I think these changes would be good:

fix the entropy issue as per @evan-brass ’s approach
avoid call paths to randombytes by passing in safely generated ids to simple-peer
top comment mentioned something about a require making it a non-esm, didn’t see that here, just checking
remove any unnecessary browserify deps for local esbuild (these still may be necessary due to simple-peer)

should be done

Thank you! Headed to airport but will test this tonight and merge if it looks good. Appreciate the PR!

Pulled into https://github.com/gfodor/p2pcf/pull/3, thank you for the PR!


use correct prop_kind for mkl-dnn FC layer

Description
use correct prop_kind for mkl-dnn FC layer
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

@zheng-da @pengzhao-intel just a minor change, this is to use correct prop_kind for FC layer.

@ashokei does the incorrect prop_kind cause perf issues?

i have not noticed performance changes; But if mkl-dnn optimizes for inference in future, this change will make it transparently/automatically work.

Just to clarify, is this a bugfix, performance improvement or something else?


Comments api missing

Subreddit, user and multireddit should expose a method to retrieve the last comments.
Some examples:

/r/redditdev
/u/spez
/u/multi-mod/m/cats

It should be as easy as adding a ._getListing({uri: url + '/comments', qs: options});
I've used it on my tool.
Thanks for snoowrap.

Sorry, I lost track of this issue.
Actually, I think there are methods for the first two:

Subreddit#getNewComments
RedditUser#getComments

But you're right that the API for multireddit comments is missing.


Add project short name to Run Checks title

User Story
As a user, I want the name of the project in the title of Run Checks so that I know which project I am running the checks on.
Description
Add the project short name to Run Checks of the project that the checks are getting run on.

UX: Feel free to change the content of what is in the Run Checks title (e.g. have the short name - full name). I just put the short name there as a starting place/place holder.

Comment that was previously in the description before rework:

We're possibly going to be able to run checks from what was the "results list" tab from PT9. So it seems to make sense to call both the run checks dialog and the results of checks, "Checks".

Testing Steps Repo:

Open the Scripture Editor with WEB project from the main hamburger menu
Verfiied that 'Configure Check..' menu item is available on the projects displayed by Scripture Editor
Open the Configure Checks .. on the webview menu on WEB project
Verify that Configure Checks - WEB webview is displayed
Verify that project  name is displayed in the webview title Configure Checks - WEB


Update tag validation

To add in tag validation where the following requirements have to be met for tags:

Tags cannot be blank
Tags can have at most 30 characters

Fix by #47


add 'createDataSource' method to JdbcDatabaseContainer

WDYT? @rnorth

WDYT? @bsideup

I'm afraid I don't think we should be adding a compile-scoped dependency on Hikari or any other DB pool to the main JDBC module. Doing so is a step too far in terms of forcing a particular implementation upon users.
I'm afraid I don't see any route to exposing a DataSource implementation that I'd be comfortable with.

It looks like you’ve shaded Hikari in this new commit. I really don’t want to go down this route. I think the user (or the libraries they bring) should be responsible for DataSource creation, just as they are in production code. Otherwise there’s just a huge likelihood of tests being non-representative.
Sorry but I’m going to close this PR, as I don’t think we’ll be able to accept it.
Sent with GitHawk


Error when running in Snowflake

Got
2022-07-28T14:26:33.777084Z: dbt runtime exception
Compilation Error in operation data_transformation-on-run-end-1 (./dbt_project.yml)
  Object of type ColumnInfo is not JSON serializable

I get the same error. Running package version 0.1.0 with dbt version 1.3.0
Compilation Error in operation dbt_snowflake_starterpack-on-run-end-1 (.\dbt_project.yml)
  Object of type Undefined is not JSON serializable

  > in macro upsert_results (macros\upsert_results.sql)
  > called by macro generate (macros\generate.sql)
  > called by macro metadata_columns (macros\metadata_columns.sql)
  > called by operation dbt_snowflake_starterpack-on-run-end-1 (.\dbt_project.yml)

I get this error as well.  Package version 0.1.0 and dbtCloud version 1.2
Object of type ColumnInfo is not JSON serializable

in macro upsert_results (macros/upsert_results.sql)
called by macro generate (macros/generate.sql)
called by macro metadata_columns (macros/metadata_columns.sql)
called by operation bi_data_analytics-on-run-end-0 (./dbt_project.yml)


Could you provide the format of train_dataset csv? thanks

Could you provide the format of train_dataset csv? thanks

If you are referring to this, I believe $train_df$ should be $N \times C$ where $N$ is the number of training samples and $C$ is the context length of each sample.


Cross-Instrument Modulation Mechanism

Same-instrument modulation behaves differently from cross-instrument modulation - this is a discussion ticket and also a point of reference for the workflow with parameter modulation from the global instrument.
Situation: When using a "send" unit that targets

the same instrument, by default, all voices of the instrument will be modulated - or the exact voice selected by the "voice" parameter in the "send" unit.
a different instrument, only the first voice of the target instrument will be modulated by default (respecting stereo), or the exact voice selected by the "voice" parameter in the send unit.

A discussion with @vsariola reveiled that this is by design, and the intended workflow for cross-instrument modulation is
to create a modulation unit followed by as many "send" units as the target instrument's voice count (the first "send" unit without sendpop, the last one with sendpop enabled).

Slight correction: the situation currently is that every send always just modulates one voice. If you want to modulate an instrument with multiple voices, let's say three, you need three different SENDs.
The meaning of "auto":

If the unit is within the same instrument, the modulation targets always "self" i.e. if this is the voice 0 of the instrument, that modulation would target voice 0. Similarly, if this is voice 1 of a multivoice instrument, "auto" modulation modulates a unit in voice 1.
The meaning of "auto" is confusing when cross-modulating, as it actually just modulates voice 0 of another instrument.

Proposed fix:

For self-modulating instruments, rename "auto" to "self" to make it more clear that this means "the voice itself"
Give new meaning for "auto" in the cross-modulating instruments: "all". "all" would mean that all the voices are modulated; this would be implented by compiling the send to multiple units.

I don't think there's no use case for self-modulating "all", as it likely would lead to weird behavior anyway. However, it is still possible to implement that manually, just by chaining N sends, where N is the number of voices.

Ok, there's a catch though, which is minor: if we actually compile a send unit into multiple sends, then if an another send is modulating this send only targets the first. But send modulating send is such a rare occurrence that maybe this is not an issue.

Can you try the quick test in feat/all-modulation branch if it would've worked for what you were trying to do?

Yes, this is exactly what I tried to do :) thanks!

Also: The old variant still works.

Merged, enjoy!


The result of CWT

Please, using the "pywt.cwt" comment deal the wav file in python. Get the result is complex martix.  What does it mean? How to get the frequency information of the audio?

This question doesn't make sense to me, I'm sorry - I'll close this issue.


Let's try this again! Fixes status bar timer stat

I love this plugin. One tiny thing that bothers me is the timer on the status bar never updates the last-synced time; the current status bar always reads "Last sync a few seconds ago."
This is a small change that will mean the status bar will look something like this after a while:

Please let me know if this type of change is unwelcome or if you'd like to see any modifications!

@hadynz sorry for the confusion earlier; this is the change that I meant to make! Please let me know if this is unwelcome or you want to see edits to it.


phi-1.5 lm_head bias is not loaded with LoRA/Adapter-v2 fine-tuning

Unlike other LLMs, phi-1.5 model has bias in the LM head. The pretrained bias is not loaded when fine-tuning phi-1.5 with LoRA or Adapter-v2. It doesn't raise an error when fine-tuning the model as strict=False is passed to load_state_dict(). However, an error is raised when generating or merging phi-1.5 with LoRA/Adapter-v2 parameters as strict=True is used. The following error is raised:
RuntimeError: Error(s) in loading state_dict for GPT:
        Missing key(s) in state_dict: "lm_head.linear.bias".
        Unexpected key(s) in state_dict: "lm_head.bias".

I've fixed the issue by adding lm_head.bias in _load_from_state_dict of both lit_gpt.lora.GPT and lit_gpt.adapter_v2.GPT:
def _load_from_state_dict(self, state_dict: Dict, prefix: str, *args: Any, **kwargs: Any) -> None:
        """For compatibility with base checkpoints."""
        mapping = {
            "lm_head.weight": "lm_head.linear.weight",
            "lm_head.bias": "lm_head.linear.bias"
        }
        state_dict = map_old_state_dict_weights(state_dict, mapping, prefix)
        super()._load_from_state_dict(state_dict, prefix, *args, **kwargs)

I'd be happy to create a PR.

@rlebret please feel free to create the PR


Citizen clothing can't be taken from scavenging source

There's gloves in the scavenging source, but we can't take them from it.
It caused this error (which I fixed), but the problem remains:
L04/28/2024 - 14:20:19: Lua Error:
[ERROR] gamemodes/experiment-redux/schema/items/base/sh_citizen_clothing.lua:94: attempt to index local 'client' (a nil value)

RemoveOutfit - gamemodes/experiment-redux/schema/items/base/sh_citizen_clothing.lua:94
unknown - gamemodes/helix/gamemode/items/base/sh_outfit.lua:238
PerformInventoryAction - gamemodes/helix/gamemode/core/libs/sh_item.lua:662
func - gamemodes/helix/gamemode/core/libs/sh_item.lua:801
unknown - lua/includes/extensions/net.lua:38

Same thing for 'basic shirt' item, seems the items are somehow equipped? Causing them to not be transferrable


Advanced search possible?

A beginners question:
In the web interface I can do advanced searches like “word1 AND word2” and it will bring up documents, that contain both words. This doesn’t work in the app. Is this a general issue based on the architecture or is there a way to get advanced searches also with the app?
Thanks!

@SiggiKeller Definitely possible. This is covered by #75, and is something I should be able to tackle soon!


Verbose logging on tests

I cant find a setting on phantom-testing to disable the massive console.log output
e.g.
9042 available
Starting cassandra
14:48:34.974 [pool-6-thread-1] INFO  o.a.c.config.YamlConfigurationLoader - Loading settings
Is there a way to disable this?

@elmalto All loggers have been successfully moved to slf4j compatible api, which means you can configure all loggers using an xml configuration or whatever other supported config format. Perhaps a much better place to continue with this is here: http://slf4j.org/faq.html.
Hope this helps

perfect, thank you


Fix: Validate versions before comparing

Comparison throws errors while parsing versions like  "^2.0.0-beta.2" in package.json

Thanks, merged and released 1.3.4


question/feature: transparent proxying

Is bind to a nonlocal IP address possible ? (Similar to Linux's IP_TRANSPARENT socket option + TPROXY ip_tables target )
Thanks!

Don't support such feature.

Thanks!
I'm new to DPDK/ANS so sorry in advance for any stupid questions  :)
Do you believe adding this feature is a) non practical (very hard) b) requires a non trivial refactor or c) a simple hack?
I'm asking since I found this feature is supported here in pkelsey/libuinet
Hope you find this question valid :)

It isn't common feature, so didn't support it.
Why do you need this feature?

I would like to use it within nginx as a tcp/udp transparent proxy.
Actually nginx v1.11 supports this feature. here is the source.
I realise current dkpk-nginx will require an upgrade.

Do you have interest to rebase dpdk-nginx to nginx-1.11.3 ? -:)

Actually yes.
Seems you guys did an elegant and clean porting work :)
git diff --name-only 6f68f95891dc16a868f607c5828750bf5a07fa3b ef4062016dbe5babbe5e02b9b5aeb72a8a9bbbd5
README.md
auto/cc/gcc
auto/make
auto/sources
conf/nginx.conf
src/core/nginx.c
src/event/modules/ngx_opendp_module.c
src/os/unix/ngx_linux_config.h

dpdk-nginx changes from v1.9.5 doesn't look too intimidating.
Will you guys be able to enhance ANS with the transparent proxy feature ? :-)

In future, maybe enhance ANS with the transparent proxy feature.


Old colormap palettes have strange colors toward the ends

It looks like older colormaps provided by vcs often were smaller than the newer colormaps. As a result, the "ends" of the colormaps seem to be filled with random colors which makes users confused. Is there a fix for this @doutriaux1 ?

this is due to these colormap being designed to use the range 16->239 whereas now we use the full range, eidting the graphic method will let user set the correct range


Ignoring

Hi 👋 ,
first of all, thank you for your work on this package. It works great expect for one case:
Parsing <script> tags.
I prepared a codesandbox for this. As you can see the script tag is not rendered at all.
Codesandbox: https://codesandbox.io/s/vigorous-boyd-ptj8y
Did I miss some kind of configuration to handle script tags properly?
Cheers,
Achim

@hauptrolle I think this is similar to this issue in a similar library to this:
https://github.com/remarkablemark/html-react-parser/issues/98
TL;DW: It seems react-dom ignores script elements.

@martin-eq Yeah, I found this issue as well. Sad that react-dom is ignoring it 😞 I will close this issue...


Discrepancy in requires-dist Metadata between PyPi and  pyproject.toml

Hi,
I noticed that the requires-dist field is set to null in the PyPI JSON API for the package argon2-cffi-bindings (https://pypi.org/pypi/argon2-cffi-bindings/json) but in the pyproject.toml file and unzipped wheel's metadata there is a dependancy ( cffi>=1.0.1) listed

I have downloaded https://files.pythonhosted.org/packages/ed/55/f8ba268bc9005d0ca57a862e8f1b55bf1775e97a36bd30b0a8fb568c265c/argon2_cffi_bindings-21.2.0-pp38-pypy38_pp73-win_amd64.whl to double-check and it's METADAT file says Requires-Dist: cffi (>=1.0.1) so I don't think this is my fault.
Either it's a bug on the PyPI side, or they haven't backfilled that data yet.


In detox/build.gradle: Could not find method minReactNative44Implementation()

Description / Steps to Reproduce

Update to<EMAIL_ADDRESS>(on react-native@0.52.0).
Run ./gradlew clean from the React Native project's android/ directory.

This results in the following output:
Running  ./gradlew clean ...
Starting a Gradle Daemon (subsequent builds will be faster)
Reading env from: .env
Reading env from: .env

FAILURE: Build failed with an exception.

* Where:
Build file '/Users/sunw/Skale/Repos/skale-react-native/Skale/node_modules/detox/android/detox/build.gradle' line: 60

* What went wrong:
A problem occurred evaluating project ':detox'.
> Could not find method minReactNative44Implementation() for arguments [com.squareup.okhttp3:okhttp:3.4.1] on object of type org.gradle.api.internal.artifacts.dsl.dependencies.DefaultDependencyHandler.

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Detox, Node, Device, Xcode and macOS Versions

Detox: 7.0.0-alpha.0
Node: 5.6.0
Device: MacBook Pro 2016

This issue still exists in<EMAIL_ADDRESS>

Same for 7.1.0
I tried to follow the gradle 3 instructions but the app won't even compile :(

Upgrading Gradle worked for me...
Modified build.gradle in the root android folder

Also make sure in the app/build.gradle file you have this..
dependencies {
    ....
    androidTestCompile(project(path: ":detox", configuration: "newOkhttpDebug"), {
      exclude group: 'com.android.support', module: 'support-annotations'
    })
    androidTestCompile 'junit:junit:4.12'
    androidTestCompile 'com.android.support.test:runner:1.0.1'
    androidTestCompile 'com.android.support.test:rules:1.0.1'
}

And that should solve the Test issues you're having?

Is there a solution that does not involve updating Gradle? It'd be nice to have Detox work right after react-native init (especially since that's generally more compatible with other RN libraries).

@shockdesign the app/build.gradle dependencies alone (without upgrading Gradle) do not resolve the issue.

@sunweiyang you have to upgrade Gradle as Detox 7 relies on changes in Gradle to work properly.

@shockdesign I updated based on your suggestions and https://developer.android.com/studio/build/gradle-plugin-3-0-0-migration.html but I get 2 errors now:

If I add the newOkhttpDebug line I get a flavorDimensions not existent error.
If I just do  debugImplementation(project(path: ":detox")) the app compiles, gets intalled on the genymotion sim or real device but then it doesn't start  and will lead to a timeout error.

Any ideas?
Thank you!

@rborn Sorry, your debugImplementation should be androidTestImplementation but that should work with just project(path: ":detox")) and no configuration

@shockdesign I managed to fix it, but I don't remember what I did, it was me doing some stupid thing (more than sure I was changing stuff in the wrong place). Thanks for the reply and sorry for not getting back in time 😔

Related to: https://github.com/wix/detox/issues/774

Not really related since this is a build time dependency, the computer does a great job at stopping bad configurations/broken dependencies. Running tests however has no validation, I want to add runtime validation to versions of cli tools we use.

Though this issue is closed, I would like to address a few of the issues raised here.
There are two flavours to detox Android, one for rn44-45, and the other for 46 and up. Please make sure you read the Android setup docs.
newOkhttpDebug is the old API, it was changed between Detox 6 and 7

@rotemmiz , I see your point. In any case, it could be a more user-friendly error message, so maybe it's a nice-to-have one.

We have bigger problems 😣


Status icons on avatars lack contrast

This is a followup I originally posted at https://github.com/zulip/zulip-mobile/pull/3417#issuecomment-474641128 just before merging that PR.
The "unavailable" icon lacks contrast on top of an avatar:

Possible fix: give it a partly-opaque background? Or even fully opaque.

Something similar would probably benefit the other icons too -- if someone's avatar happens to have green or similar bright colors in the lower right, even the "active" color might not stand out. Perhaps a contrasting (white?) border would be good.

I just did a quick test and the behavior is the same as it was then, so this is still live.

hey greg ,
I Think we can do two things or either of one of below for this issue

We can make our back ground partially-opaque for every status ,

Or , we can make our icon circular by increasing border radius and then put that status symbol half on avatar and half outside
for eg.

Hi @abhi0504 !
Zulip's avatars are meant to be displayed as rounded squares, not circles. And quoting Tim at #205:

This is based on a lot of consideration -- circular avatars are problematic because many images that we'd like to use in avatars (e.g. bot logos) don't actually look good in circular form, whereas just about anything looks good in a rounded square.

I think an opaque or partly-opaque background around each status icon, and perhaps an opaque border, would be a good solution. Your example image demonstrates that (in addition to the avatar shape) and I think it works well.

@gnprice  thanks for your help , ok so we are keeping that rounded squares with partly-opaque background and perhaps an opaque border so should I started working this issue or any other suggestions

@abhi0504 You've already claimed #4307, so let's start with that, and then you can take this one up next.

@gnprice I have also done some changes and submitted a PR for this issue as we have discussed
Before

After

@gnprice can you review this PR for the above issue


Credit card clustering

💥 Proposal
@khusheekapoor
to make a clustering model that can make groups of credit card customers
the dataset i would like to use is:-https://www.kaggle.com/datasets/aryashah2k/credit-card-customer-data
i am interested in doing this issue so kindly assign me this issue

💥 Proposal
@khusheekapoor
to make a clustering model that can make groups of credit card customers
the dataset i would like to use is:-https://www.kaggle.com/datasets/aryashah2k/credit-card-customer-data
i am interested in doing this issue so kindly assign me this issue
@khusheekapoor

💥 Proposal:
@khusheekapoor
With this , I aim to develop a clustering model which groups credit card holders based on their buying habits, credit limits, and many more financial factors. One great dataset I came from:
https://www.kaggle.com/datasets/arjunbhasin2013/ccdata
Please assign this project to me!
I promise to work hard and complete it on time!

@lcs2022026 - you can go ahead! We are assigning you 21 days for this project, after which it will be assigned to someone else if not completed. All the best!  Name the file as: algorithm_dataset.ipynb and link it in the readme of the labeled directory as algorithm - dataset.

@lcs2022026 Please tell us which clustering model you will be using.

k means clustering

okay

@theyashwanthsai
can i go ahead start doing the project?: )

@lcs2022026 - you can go ahead! We are assigning you 21 days for this project, after which it will be assigned to someone else if not completed. All the best!  Name the file as: algorithm_dataset.ipynb and link it in the readme of the labeled directory as algorithm - dataset.


Compile OpenSSL from source on OSX

I'm seeing a bunch of weird illegal instructions on OSX nightlies for
Cargo. My guess is that they're all related to OpenSSL linking. Right
now we're linking from Homebrew but I have a sneaking suspicion that it
compiles with -march=native rather than what we'd like as a portable
binary. To work around this compile OpenSSL ourselves and link it that
way.
Note that I believe this won't bring in the certificate trust store of
OpenSSL on OSX (or at least not the right one from the keychain). We
shouldn't need that, however, as OpenSSL is just used as the
cryptographic primitives in libssh2 and Cargo itself. So in that sense
we shouldn't need it for actually SSL at all.

r? @brson
(rust_highfive has picked a reviewer for you, use r? to override)

I’ve seen Travis fail with "Illegal instruction: 4" on OS X on the Nigthly channel, but OpenSSL is not involved. In fact, even cargo --version fails:
https://travis-ci.org/servo/string-cache/jobs/179029570

@SimonSapin unfortunately I haven't confirmed that the illegal instruction is specifically related to OpenSSL, but it's the biggest thing that changed that'd cause me to suspect it. OpenSSL is actually always related I believe because we initialize the various libraries (libgit2, libssh2, openssl) I believe on startup no matter the command. So in that sense I think there's at least a vector for OpenSSL to get involved?
Obviously a stack trace would be best but unfortunately I don't know how to get one out of Travis.

Oh, sorry, you mean cargo itself using OpenSSL. I was thinking of cargo building the rust-openssl crate.

Oh right yeah Cargo's linking to OpenSSL, but the way we do that changed very recently, and that's what I think the bug is (pulling in bad binaries).
Another reason I suspect this is at fault is that locally Cargo works just fine for me, but I also likely have a more recent Mac with a newer CPU than what Travis is running (presumably)

@bors: r+

:pushpin: Commit 8ab8595 has been approved by alexcrichton

:hourglass: Testing commit 8ab8595 with merge 3568be9...

:sunny: Test successful - cargo-cross-linux, cargo-linux-32, cargo-linux-64, cargo-mac-32, cargo-mac-64, cargo-win-gnu-32, cargo-win-gnu-64, cargo-win-msvc-32, cargo-win-msvc-64
Approved by: alexcrichton
Pushing 3568be94c0ca73488954ad209c07e7998786b3d9 to master...


APIv2:doc: Fix swagger doc to refer to volumes

From reading the contrib guide, it sounds like I need to just add sign-off on the commit here (and any future PRs). Since my account is a pseud, is signing off with my real name and the github proxied email address okay?

That should be fine

/approve
/ok-to-test
LGTM

Thanks @mheon - new commit pushed. LMK if you need anything else from me here :)


xformers without triton (openAI) and other issues.

Hi Dustin,
thanks for your great work.
I was trying to run mistral-7b on Jetson ORIN with Jetpack (# R35 (release), REVISION: 4.1, GCID: 33958178, BOARD: t186ref, EABI: aarch64, DATE: Tue Aug  1 19:57:35 UTC 2023).
I built a docker image with xformers from this repo to run it as mistral depends on xformers. However, it did not succeed due to the following issues:
python3 -m main demo mistral-7B-v0.1/
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.0.0+nv23.05 with CUDA 1104 (you have 2.0.0+nv23.05)
    Python  3.8.10 (you have 3.8.10)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
Traceback (most recent call last):
  File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/workspace/cj/.nlp/mistral-src/main.py", line 171, in <module>
    fire.Fire(
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 141, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 475, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 691, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "/workspace/cj/.nlp/mistral-src/main.py", line 154, in demo
    res, _logprobs = generate(
  File "/usr/local/lib/python3.8/dist-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/workspace/cj/.nlp/mistral-src/main.py", line 75, in generate
    prelogits = model.forward(
  File "/workspace/cj/.nlp/mistral-src/mistral/model.py", line 241, in forward
    return self.output(self.forward_partial(
  File "/workspace/cj/.nlp/mistral-src/mistral/model.py", line 228, in forward_partial
    h = layer(h, freqs_cis, cache_view)
  File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/workspace/cj/.nlp/mistral-src/mistral/model.py", line 172, in forward
    r = self.attention.forward(self.attention_norm(x), freqs_cis, cache)
  File "/workspace/cj/.nlp/mistral-src/mistral/model.py", line 115, in forward
    output = memory_efficient_attention(xq, key, val, None if cache is None else cache.mask)
  File "/usr/local/lib/python3.8/dist-packages/xformers/ops/fmha/__init__.py", line 223, in memory_efficient_attention
    return _memory_efficient_attention(
  File "/usr/local/lib/python3.8/dist-packages/xformers/ops/fmha/__init__.py", line 321, in _memory_efficient_attention
    return _memory_efficient_attention_forward(
  File "/usr/local/lib/python3.8/dist-packages/xformers/ops/fmha/__init__.py", line 337, in _memory_efficient_attention_forward
    op = _dispatch_fw(inp, False)
  File "/usr/local/lib/python3.8/dist-packages/xformers/ops/fmha/dispatch.py", line 120, in _dispatch_fw
    return _run_priority_list(
  File "/usr/local/lib/python3.8/dist-packages/xformers/ops/fmha/dispatch.py", line 63, in _run_priority_list
    raise NotImplementedError(msg)
NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs:
     query       : shape=(1, 27, 32, 128) (torch.float16)
     key         : shape=(1, 27, 32, 128) (torch.float16)
     value       : shape=(1, 27, 32, 128) (torch.float16)
     attn_bias   : <class 'xformers.ops.fmha.attn_bias.BlockDiagonalCausalLocalAttentionMask'>
     p           : 0.0
`decoderF` is not supported because:
    xFormers wasn't build with CUDA support
    attn_bias type is <class 'xformers.ops.fmha.attn_bias.BlockDiagonalCausalLocalAttentionMask'>
    operator wasn't built - see `python -m xformers.info` for more info
<EMAIL_ADDRESS>is not supported because:
    xFormers wasn't build with CUDA support
`tritonflashattF` is not supported because:
    xFormers wasn't build with CUDA support
    attn_bias type is <class 'xformers.ops.fmha.attn_bias.BlockDiagonalCausalLocalAttentionMask'>
    operator wasn't built - see `python -m xformers.info` for more info
    triton is not available
`cutlassF` is not supported because:
    xFormers wasn't build with CUDA support
    operator wasn't built - see `python -m xformers.info` for more info
`smallkF` is not supported because:
    max(query.shape[-1] != value.shape[-1]) > 32
    xFormers wasn't build with CUDA support
    dtype=torch.float16 (supported: {torch.float32})
    attn_bias type is <class 'xformers.ops.fmha.attn_bias.BlockDiagonalCausalLocalAttentionMask'>
    operator wasn't built - see `python -m xformers.info` for more info
    unsupported embed per head: 128

and info about xformers
python3 -m xformers.info
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.0.0+nv23.05 with CUDA 1104 (you have 2.0.0+nv23.05)
    Python  3.8.10 (you have 3.8.10)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
xFormers 0.0.23
memory_efficient_attention.cutlassF:               unavailable
memory_efficient_attention.cutlassB:               unavailable
memory_efficient_attention.decoderF:               unavailable
<EMAIL_ADDRESS>        available
<EMAIL_ADDRESS>        available
memory_efficient_attention.smallkF:                unavailable
memory_efficient_attention.smallkB:                unavailable
memory_efficient_attention.tritonflashattF:        unavailable
memory_efficient_attention.tritonflashattB:        unavailable
memory_efficient_attention.triton_splitKF:         unavailable
indexing.scaled_index_addF:                        unavailable
indexing.scaled_index_addB:                        unavailable
indexing.index_select:                             unavailable
swiglu.dual_gemm_silu:                             unavailable
swiglu.gemm_fused_operand_sum:                     unavailable
swiglu.fused.p.cpp:                                not built
is_triton_available:                               False
pytorch.version:                                   2.0.0+nv23.05
pytorch.cuda:                                      available
gpu.compute_capability:                            8.7
gpu.name:                                          Orin
build.info:                                        available
build.cuda_version:                                1104
build.python_version:                              3.8.10
build.torch_version:                               2.0.0+nv23.05
build.env.TORCH_CUDA_ARCH_LIST:                    7.2;8.7
build.env.XFORMERS_BUILD_TYPE:                     None
build.env.XFORMERS_ENABLE_DEBUG_ASSERTIONS:        None
build.env.NVCC_FLAGS:                              None
build.env.XFORMERS_PACKAGE_FROM:                   None
source.privacy:                                    open source

I wonder if you could  help look into this. Thanks in advance.

Hi @cj401, when I run python3 -m xformers.info, this is the output and CUDA is reported to be enabled:
docker run --runtime nvidia dustynv/xformers:r35.4.1 python3 -m xformers.info
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
xFormers 0.0.22.post7
memory_efficient_attention.cutlassF:               available
memory_efficient_attention.cutlassB:               available
memory_efficient_attention.decoderF:               available
<EMAIL_ADDRESS>       available
<EMAIL_ADDRESS>       available
memory_efficient_attention.smallkF:                available
memory_efficient_attention.smallkB:                available
memory_efficient_attention.tritonflashattF:        unavailable
memory_efficient_attention.tritonflashattB:        unavailable
memory_efficient_attention.triton_splitKF:         unavailable
indexing.scaled_index_addF:                        unavailable
indexing.scaled_index_addB:                        unavailable
indexing.index_select:                             unavailable
swiglu.dual_gemm_silu:                             available
swiglu.gemm_fused_operand_sum:                     available
swiglu.fused.p.cpp:                                available
is_triton_available:                               False
pytorch.version:                                   2.0.0+nv23.05
pytorch.cuda:                                      available
gpu.compute_capability:                            8.7
gpu.name:                                          Orin
build.info:                                        available
build.cuda_version:                                1104
build.python_version:                              3.8.10
build.torch_version:                               2.0.0+nv23.05
build.env.TORCH_CUDA_ARCH_LIST:                    7.2;8.7
build.env.XFORMERS_BUILD_TYPE:                     None
build.env.XFORMERS_ENABLE_DEBUG_ASSERTIONS:        None
build.env.NVCC_FLAGS:                              None
build.env.XFORMERS_PACKAGE_FROM:                   None
build.nvcc_version:                                11.4.315
source.privacy:                                    open source

I suspect that the mistralai package is installing a different version of xformers (0.0.23 in your case)
I'd either edit the mistral src to not specify a specific xformers version (e.g. in the requirements.txt or project.toml), or uninstall/re-install xformers after installing mistral and make sure xformers builds with CUDA enabled.
See here in the xformers dockerfile for how it's installed:
https://github.com/dusty-nv/jetson-containers/blob/master/packages/llm/xformers/Dockerfile

Hi @dusty-nv  thanks for your prompt reply.
when I run python3 -m xformers.info (mistral does not need to install and have no project.toml file as well :) ).
Not sure if my host cuda environment was messed up? I did not change the xformers dockerfile for building this.
docker run --runtime nvidia cj_orin_container:r35.4.1 python3 -m xformers.info
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.0.0+nv23.05 with CUDA 1104 (you have 2.0.0+nv23.05)
    Python  3.8.10 (you have 3.8.10)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
xFormers 0.0.23
memory_efficient_attention.cutlassF:               unavailable
memory_efficient_attention.cutlassB:               unavailable
memory_efficient_attention.decoderF:               unavailable
<EMAIL_ADDRESS>        available
<EMAIL_ADDRESS>        available
memory_efficient_attention.smallkF:                unavailable
memory_efficient_attention.smallkB:                unavailable
memory_efficient_attention.tritonflashattF:        unavailable
memory_efficient_attention.tritonflashattB:        unavailable
memory_efficient_attention.triton_splitKF:         unavailable
indexing.scaled_index_addF:                        unavailable
indexing.scaled_index_addB:                        unavailable
indexing.index_select:                             unavailable
swiglu.dual_gemm_silu:                             unavailable
swiglu.gemm_fused_operand_sum:                     unavailable
swiglu.fused.p.cpp:                                not built
is_triton_available:                               False
pytorch.version:                                   2.0.0+nv23.05
pytorch.cuda:                                      available
gpu.compute_capability:                            8.7
gpu.name:                                          Orin
build.info:                                        available
build.cuda_version:                                1104
build.python_version:                              3.8.10
build.torch_version:                               2.0.0+nv23.05
build.env.TORCH_CUDA_ARCH_LIST:                    7.2;8.7
build.env.XFORMERS_BUILD_TYPE:                     None
build.env.XFORMERS_ENABLE_DEBUG_ASSERTIONS:        None
build.env.NVCC_FLAGS:                              None
build.env.XFORMERS_PACKAGE_FROM:                   None
source.privacy:                                    open source

Not sure if my host cuda environment was messed up? I did not change the xformers dockerfile for building this.

Hi @cj401, it shouldn't be related to your host CUDA environment, because you're on JetPack 5 and CUDA is installed inside the containers there.  What command(s) did you use to build your container?   I just tried rebuilding my xformers container here, and it is still working as expected.
One other thing - have you set your default docker runtime to nvidia?   https://github.com/dusty-nv/jetson-containers/blob/master/docs/setup.md#docker-default-runtime

@dusty-nv  thanks for your prompt reply.
Yes. this setting has been followed already as shown.
nvidia@nvidia-desktop:~$ sudo docker info | grep 'Default Runtime'
 Default Runtime: nvidia

The command line I used to build xformers container is:
./build.sh --name=test_xformers xformers
And at the end of this, it emits:
testing xformers...
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.0.0+nv23.05 with CUDA 1104 (you have 2.0.0+nv23.05)
    Python  3.8.10 (you have 3.8.10)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
xFormers 0.0.23
**memory_efficient_attention.cutlassF:               unavailable
memory_efficient_attention.cutlassB:               unavailable
memory_efficient_attention.decoderF:               unavailable**
<EMAIL_ADDRESS>        available
<EMAIL_ADDRESS>        available
**memory_efficient_attention.smallkF:                unavailable
memory_efficient_attention.smallkB:                unavailable**
memory_efficient_attention.tritonflashattF:        unavailable
memory_efficient_attention.tritonflashattB:        unavailable
memory_efficient_attention.triton_splitKF:         unavailable
indexing.scaled_index_addF:                        unavailable
indexing.scaled_index_addB:                        unavailable
indexing.index_select:                             unavailable
**swiglu.dual_gemm_silu:                             unavailable
swiglu.gemm_fused_operand_sum:                     unavailable
swiglu.fused.p.cpp:                                not built**
is_triton_available:                               False
pytorch.version:                                   2.0.0+nv23.05
pytorch.cuda:                                      available
gpu.compute_capability:                            8.7
gpu.name:                                          Orin
build.info:                                        available
build.cuda_version:                                1104
build.python_version:                              3.8.10
build.torch_version:                               2.0.0+nv23.05
build.env.TORCH_CUDA_ARCH_LIST:                    7.2;8.7
build.env.XFORMERS_BUILD_TYPE:                     None
build.env.XFORMERS_ENABLE_DEBUG_ASSERTIONS:        None
build.env.NVCC_FLAGS:                              None
build.env.XFORMERS_PACKAGE_FROM:                   None
source.privacy:                                    open source
xformers OK

It can be seen that the bold highlighted parts are unavailable on my side, however, they are enabled on your side. :)
Actually, I was trying to build xformers and triton (openAI) from source and installed them.  I still got issues with my building,
python3 -m xformers.info
WARNING[XFORMERS]: Need to compile C++ extensions to use all xFormers features.
    Please install xformers properly (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
xFormers 0.0.0
memory_efficient_attention.cutlassF:               unavailable
memory_efficient_attention.cutlassB:               unavailable
memory_efficient_attention.decoderF:               unavailable
<EMAIL_ADDRESS>        unavailable
<EMAIL_ADDRESS>        unavailable
memory_efficient_attention.smallkF:                unavailable
memory_efficient_attention.smallkB:                unavailable
memory_efficient_attention.tritonflashattF:        unavailable
memory_efficient_attention.tritonflashattB:        unavailable
memory_efficient_attention.triton_splitKF:         available
indexing.scaled_index_addF:                        available
indexing.scaled_index_addB:                        available
indexing.index_select:                             available
swiglu.dual_gemm_silu:                             unavailable
swiglu.gemm_fused_operand_sum:                     unavailable
swiglu.fused.p.cpp:                                not built
is_triton_available:                               True
pytorch.version:                                   2.1.0a0+41361538.nv23.06
pytorch.cuda:                                      available
gpu.compute_capability:                            8.7
gpu.name:                                          Orin
build.info:                                        none
source.privacy:                                    open source

I reckon I properly mis-read something in the setup.py from xformers.  Thanks any way.

Hi @dusty-nv , I wonder if you used the following command line to build the docker image on your ORIN. Thanks.
./build.sh --name=test_xformers xformers

Hmm yes, that is the same that I ran here, on the same version of JetPack-L4T...

Thanks for chasing this down @xunkai55 - it's unfortunate, because it seems the only hard dependency on torch.distributed in xformers was more recently added in its C++/C10 extension and appears to be temporary in nature:
https://github.com/facebookresearch/xformers/blob/6600003c2314af88befcec2cd6662957a662981d/xformers/csrc/boxing_unboxing.cpp#L8
Right now I am building/testing xformers against pytorch:distributed instead of pytorch, and if it works well I will push the changes.   Normally I would try to patch out the use of torch.distributed in the xformers code as to not alter the entire build chain of PyTorch that other containers might rely on, but in this case it seems difficult/not-worthwhile and not that many of my other containers rely on xformers.  And this is really only a JetPack 5 issue, because on JetPack 6 in my containers I default to USE_DISTRIBUTED=on in PyTorch.

OK, the test build was a success, so I committed this in https://github.com/dusty-nv/jetson-containers/commit/6f071067de2b98828bfc91a9de55da3c805b8aca.  The dependent containers are rebuilding now.


enable prettier by default

Summary
I removed "requirePragma": true from prettierrc because that option means prettier is not enabled unless explicitly turned on using the @format pragma (as it was in example/index.js).
After that I just ran eslint --fix and the code now follows the specified config.

Test Plan

eslint passes (it does locally :) )

What's required for testing (prerequisites)?
What are the steps to reproduce (after prerequisites)?
Compatibility

OS
Implemented

iOS
✅❌

Android
✅❌

Checklist

[ ] I have tested this on a device and a simulator
[ ] I added the documentation in README.md
[ ] I mentioned this change in CHANGELOG.md
[ ] I updated the typed files (TS and Flow)
[ ] I added a sample use of the API in the example project (example/App.js)

Mind rebasing on master?

@msand done; also rmeoved "git add" from lint-staged because I was getting

⚠ Some of your tasks use git add command. Please remove it from the config since all modifications made by tasks will be automatically added to the git commit index.


Adding R Markdown for R completion

I'm currently trying out your plugin, and it looks very nice so far - thanks a lot for you effort! I code a lot in R, but do so inside R Markdown (filetype = rmarkdown, extensions .Rmd and .rmd). Getting the r-languageserver to work in normal R scripts works just fine, but I also want it to work inside R Markdown files.
I assume I have to change the allowlist or something similar, but I cannot find out how to do it in the documentation. Any help?

I fixed it. You can update vim-easycomplete. rmd and rmarkdown filetypes are supported by default.
After updating. You can add missing filetypes via g:easycomplete_filetypes:
let g:easycomplete_filetypes = {
      \   "sh": {
      \     "whitelist": ["shell"]
      \   },
      \   "r": {
      \     "whitelist": ["rmd", "rmarkdown"]
      \   },
      \ }

Thanks, that works perfectly!


Parse file path

Fix parse file path that includes spaces in name on CIARE mark file open.

Fixed on last commit.


Add LICENSE content. [phab:D237]

Created by zarko at 2015-05-11 22:33:58:
cp third_party/llvm/llvm/LICENSE.TXT third_party/llvm/LICENSE
Copy zlib's LICENSE lines from its README
Download re2's LICENSE and gflags's COPYING.txt

schroederc accepted this revision at 2015-05-11 22:39:03

zarko closed via commit fcd0531715a82e47a4b1404473e99506babdfb90 at 2015-05-11 22:40:57


⚠ ETF has degraded performance

In 11596c0, ETF (https://markets.hankyung.com/equity-product/etf) experienced degraded performance:

HTTP code: 200
Response time: 6848 ms

Resolved: 한경주요지수-코스피 performance has improved in 3f6fbc4.


serve api should accept str for model argument

Closes https://github.com/iterative/mlem/issues/412

It's already fixed in #413

It's already fixed in #413

Do you wanna merge it together with that or separately with this?


incorrect syntax

the "$" should be before the variable name

@axelgMS : Thanks for your contribution! The author, @cynthn, has been notified to review your proposed change.

#please-close @axelgMS this doc is for use in Bash on Linux using the CLI. The current syntax is correct in this case.

I tested it in Cloud Shell and it failed  :s

Weird. I tested it in Cloud Shell and it worked.... Are you sure you were in the Bash version of Cloud Shell? Try https://shell.azure.com/bash, which forces the shell to Bash. I suspect maybe you stumbled into a PowerShell session?


How to download multiple files?

I tried to edit the "download-pdf"
#!/bin/sh
cd remarkable-daily-pdf/
./rm-sync-pdf -u https://example1 -n "title1"
./rm-sync-pdf -u https://example2 -n "title2"
Only the latest pdf is always downloaded
I tried to edit the "rm-sync-pdf"
I deleted the reboot request, had a 2x download and then created a script with only reboot or did I reset manually.
But not a single file downloaded.
Thanks

Hm, if you're on a 3.* version of the remarkable OS then the gnu-wget that's packaged with this (originally from toltec) doesn't work anymore, which might be the cause of this issue. I've been making some fixes/improvements since I updated recently which should resolve this problem.
For the time being, I'd recommend grabbing the rm-sync-pdf from the dev branch. It replaces gnu-wget with the built-in wget which means we can't currently support TSL but at least it'll download some sites. I also added a -r option which allows you to choose whether or not to reset xochitl. This way you can omit that in your download-pdfs script and then just add systemctl restart xochitl at the end of the script to do the refresh and have the files show up.
Hope this solves your problem. I'm hoping to do a fair bit of updating over the next month or so which should make this project a bit more robust and usable.

Just did a pretty major refactor of the functions for this project (some some future WIPs) that should resolve this issue and a number of others. The README instructions should still be accurate, though I'll be doing a full documentation update relatively soon.
If you get the chance, please let me know if the updates have resolved your issue

I believe this is resolved, so I'll be closing this issue. A future TODO is to make a function that will prompt for adding more pdfs, like the initial install script, but that likely won't be for a while.


testing: run goimports from root, run tests not in a submodule

Changes in a directory that wasn't a submodule led to not running any
tests at all, or running goimports on them.

All tests are passing, so it's ready for another look.
I'll keep an eye on it to make sure it works for normal PRs, too.


Version bump and code cleanup

Bump to newer version of angulartics.
No need to have 8 separate waitForVendorApi calls running at once.

Solves issue #5

Thanks!


Revert "add t.Cleanup func to clear out the local cert directories creating during api server bootup"

This reverts commit b61593e6023d0cfe243b2df1acbaf0bd8ed34bbc.
Signed-off-by: Craig Jellick<EMAIL_ADDRESS>

this actually doesnt seem to be breaking anything, but it does seem like it adds a lot of noise to the logs when you encounter a test failure


stratergy='mobile' is returning desktop results

i execute this:
mobile = PSI(url=URL, category='performance', locale='en',  stratergy='mobile', api_key=API_KEY)
and in the json i see that i get the desktop result:
{'emulatedFormFactor': 'desktop', 'formFactor': 'desktop', 'locale': 'en', 'onlyCategories': ['performance'], 'channel': 'lr'}
I also verified the numbers, i sloud have scored much less in the mobile test

This is now fixed in https://github.com/FirePing32/PyPSI/releases/tag/v1.9.1.


Design proposal: cross account resource management

Related to #3
Description of changes:

Adding CARM (cross account resource management) design document

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

This is great! I love the namespace = account separation to allow for RBAC to be used for account separation.
Is there also an idea of (account, team) separation without using multiple clusters?
e.g. A developer on team-frontend has access to accounts prod, dev, stage but only for resources prefixed "team-frontend" (attribute based authentication). A dev on team-backend has access to the same accounts but uses a different IAM role to assume for "team-backend" resources.
I'm assuming in this case they would need to make 6 different namespaces for team-frontend-prod, team-frontend-dev, team-frontend-stage etc. The configMap would also need to specify account aliases instead of numbers for each RBAC role. (e.g. 123456789-frontend=arn::iam::123456789/Team-Frontend). Is there an option to automatically create namespaces for each account specified. It would also be neat, and dangerous, to clean up namespaces (thus deleting AWS resources) when an account is removed from the configMap.
In a centralized ACK cluster I would see the need for developers to switch clusters frequently (ACK cluster for AWS resources, K8s cluster for each environment for pods).
Do we see a way ACK can make that easier at all?


Facebook links not stripped of tracking info (noticed Oct 3, 2017)

Self-explanatory title. Thanks for looking into this!

Thanks for the report. Yes, looks like Facebook changed the way they're handling external links. Instead of using an onclick attribute, they now use a data-lynx-uri attribute, presumably in conjunction with a click handler that is attached using addEventListener() or equivalent.
I can easily modify DirectLinks to strip this data-lynx-uri attribute. But what I don't know is whether that actually prevents Facebook from tracking the link click. Their click handler may have access to the data in that attribute through other means.

I have updated DirectLinks with the aforementioned modification. Again, I do not know whether it will make any difference.

Thanks for the explanation and update. Unfortunately I don't know how Facebook tracks clicks, my programming knowledge is poor.

Yes, I think it would. But I wouldn't be surprised if it also made the site unusable.