Failed assertion is getting '' in debug mode

======== Exception caught by rendering library =====================================================
The following assertion was thrown during paint():
'dart:ui/painting.dart': Failed assertion: line 4306 pos 12: '<optimized out>': is not true.

The relevant error-causing widget was:
  CustomPaint file:///F:/demo/LeanDemo/lib/test/error_test.dart:92:14

When the exception was thrown, this was the stack:
#2      Canvas.drawImage (dart:ui/painting.dart:4306:12)
#3      MyPaint.paint (package:flutter_app/test/error_test.dart:126:12)
#4      RenderCustomPaint._paintWithPainter (package:flutter/src/rendering/custom_paint.dart:563:13)
#5      RenderCustomPaint.paint (package:flutter/src/rendering/custom_paint.dart:605:7)
#6      RenderObject._paintWithContext (package:flutter/src/rendering/object.dart:2317:7)
...
The following RenderObject was being processed when the exception was fired: RenderCustomPaint#701ac relayoutBoundary=up15
...  parentData: <none> (can use size)
...  constraints: BoxConstraints(w=360.0, 0.0<=h<=Infinity)
...  size: Size(360.0, 50.0)
RenderObject: RenderCustomPaint#701ac relayoutBoundary=up15
  parentData: <none> (can use size)
  constraints: BoxConstraints(w=360.0, 0.0<=h<=Infinity)
  size: Size(360.0, 50.0)

===================================================================================
In addition to the above exceptions, the network pictures in the list sometimes display disorderly
import 'dart:async';
import 'dart:typed_data';
import 'dart:ui' as ui;

import 'package:flutter/material.dart';
import 'package:flutter/services.dart';

void main() => runApp(MyApp());

class MyApp extends StatelessWidget {
  // This widget is the root of your application.
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        primarySwatch: Colors.blue,
      ),
      home: MyHomePage(),
    );
  }
}

class MyHomePage extends StatefulWidget {
  List<String> imgList = [
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
    "http://dimg.chouti.com/CHOUTI_20191210/9846E3881397444D9A3557F0A15846BB_W300H300.png",
  ];

  @override
  _MyHomePageState createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      body: Container(
        child: ListView.builder(
            itemCount: widget.imgList.length,
            itemBuilder: (BuildContext context, int index) {
              return HeadViewWidget(url: widget.imgList[index]);
            }),
      ),
    );
  }
}

class HeadViewWidget extends StatefulWidget {
  String url;

  HeadViewWidget({this.url});

  @override
  State<StatefulWidget> createState() => _HeadViewWidgetState();
}

class _HeadViewWidgetState extends State<HeadViewWidget> {
  ui.Image _src;

  @override
  void initState() {
    super.initState();
    Future.wait([loadUrl("${widget.url}?imageView2/1/w/20/h/20/interlace/1")])
        .then((results) {
      _src = results[0];
      if (mounted) {
        setState(() {});
      }
    });
  }

  Future<ui.Image> loadImageFromAssets(String path) async {
    ByteData data = await rootBundle.load(path);
    List<int> bytes =
        data.buffer.asUint8List(data.offsetInBytes, data.lengthInBytes);
    return decodeImageFromList(bytes);
  }

  @override
  Widget build(BuildContext context) {
    return Container(
      child: CustomPaint(
        painter: MyPaint(_src),
        size: Size(50, 50),
      ),
    );
  }

  Future<ui.Image> loadUrl(String url) async {
    ImageStream stream =
        new NetworkImage(url).resolve(ImageConfiguration.empty);
    Completer<ui.Image> completer = new Completer<ui.Image>();
    void listener(ImageInfo frame, bool synchronousCall) {
      final ui.Image image = frame.image;
      completer.complete(image);
      stream.removeListener(new ImageStreamListener(listener));
    }

    stream.addListener(new ImageStreamListener(listener));
    return completer.future;
  }
}

class MyPaint extends CustomPainter {
  ui.Image src;

  MyPaint(this.src);

  @override
  void paint(Canvas canvas, Size size) {
    Paint _paint = Paint();
    canvas.saveLayer(Offset.zero & size, Paint());
    _paint.color = Colors.yellowAccent;
    canvas.drawCircle(Offset(10, 12), 10, _paint);
    _paint.blendMode = BlendMode.srcIn;
    canvas.drawImage(src, Offset(0, 2), _paint);

    canvas.restore();
  }

  @override
  bool shouldRepaint(covariant CustomPainter oldDelegate) => true;
}

What Dart and Flutter versions are you using?  What platform / device?
And, just to clarify - this is debug mode, right?

Yes,this is debug mode.
• Flutter version 2.2.2 at D:\tool\dart\flutter
• Framework revision d79295af24 (8 weeks ago), 2021-06-11 08:56:01 -0700
• Engine revision 91c9fc8fe0
• Dart version 2.13.3


Build changes to nebula.netflixoss

Current big changes:

java7 bytecode produced by default
hystrix-contrib/hystrix-clj bumped to use compile 'org.clojure:clojure:1.6.0' because of this error Could not locate clojure/edn__init.class or clojure/edn.clj on classpath
hystrix-contrib/hystrix-clj using nebula-clojure which is a wrapper around clojuresque to make it behave better with our other plugins

Hystrix-pull-requests #211 FAILURE
Looks like there's a problem with this pull request

Hystrix-pull-requests #212 SUCCESS
This pull request looks good

Hystrix-pull-requests #213 SUCCESS
This pull request looks good

Moved clojure to org.clojure:clojure:1.5.1
Removed unneeded hystrix-contrib intermediate gradle project.

Thanks @rspieldenner! Once I get 1.4.0-RC6 out the door, I'll look to get this in RC7.

@rspieldenner I'd like to merge this now, but am getting a merge conflict on the gradle.properties in the root directory.  That's not merging cleanly because I bumped the current version to 1.4.0-RC7-SNAPSHOT yesterday after the RC6 release.
It's not clear to me how to manage the versioning with your changes.  Can you advise?

delete the version in gradle.properties
tag the repo at that release v1.4.0-rc.7
while your at it move the nebula.netflixoss version to 2.2.5 (I'll add to
the pull request tomorrow if you haven't done it)
On Thu, Jan 22, 2015 at 1:33 PM, Matt Jacobs<EMAIL_ADDRESS>wrote:

@rspieldenner https://github.com/rspieldenner I'd like to merge this
now, but am getting a merge conflict on the gradle.properties in the root
directory. That's not merging cleanly because I bumped the current version
to 1.4.0-RC7-SNAPSHOT yesterday after the RC6 release.
It's not clear to me how to manage the versioning with your changes. Can
you advise?
—
Reply to this email directly or view it on GitHub
https://github.com/Netflix/Hystrix/pull/469#issuecomment-71103277.


GSD Request

--- GSD JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from v4.11 to before v4.14.258",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=4cb584e0ee7df70fd0376aee60cf701855ea8c81",
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=3e93abcdcec0436fbf0b6a88ae806902426895a2"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "4cb584e0ee7df70fd0376aee60cf701855ea8c81",
      "note": "introduced"
    },
    {
      "type": "commit",
      "value": "3e93abcdcec0436fbf0b6a88ae806902426895a2",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "nfp: Fix memory leak in nfp_cpp_area_cache_add()\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v4.14.258 by commit 3e93abcdcec0436fbf0b6a88ae806902426895a2, it was introduced in version v4.11 by commit 4cb584e0ee7df70fd0376aee60cf701855ea8c81. For more details please see the references link."
}
--- GSD JSON ---

This issue has been assigned GSD-2021-1002402


Add convert_special_token_settings.py

@so298 Please review and test in the real model directories. After merging to main branch, please reflect the changes to llm-jp and llm-jp-nvlink clusters.

@hiroshi-matsuda-rit
I tried to run the script for some models, but I could not successfully convert to hf models because of len(tokenizer) == model_config["vocab_size"] assertion's failure.
For example:

exp9 model and ver3.0b1 tokenizer

Phase 5: Update model config with Hugging Face Tokenizer special token settings
python convert_special_token_settings.py /model/7B_HF_RE/test_conversion_script/
Traceback (most recent call last):
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 38, in <module>
    main()
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 32, in main
    new_model_config = update_special_token_settings(tokenizer, model_config)
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 8, in update_special_token_settings
    assert len(tokenizer) == model_config["vocab_size"], f'Different vocab size definitions: {len(tokenizer)=} and {model_config["vocab_size"]=}'
AssertionError: Different vocab size definitions: len(tokenizer)=99574 and model_config["vocab_size"]=99584

exp4+ model and ver2.2 50k tokenizer

==========================================
Phase 5: Update model config with Hugging Face Tokenizer special token settings
python convert_special_token_settings.py /model/7B_HF_RE/test_conversion_script_ver2.2_50k/
Traceback (most recent call last):
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 38, in <module>
    main()
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 32, in main
    new_model_config = update_special_token_settings(tokenizer, model_config)
  File "/model/sosuke/modelwg/convert_special_token_settings.py", line 8, in update_special_token_settings
    assert len(tokenizer) == model_config["vocab_size"], f'Different vocab size definitions: {len(tokenizer)=} and {model_config["vocab_size"]=}'
AssertionError: Different vocab size definitions: len(tokenizer)=48586 and model_config["vocab_size"]=48640

While reading this issue in huggingface transformers repo, I think tokenizer's vocab size and model's vocab size can be different to make model's vocab size GPU-friendly.
(I have not looked into Megatron-LM's logic to determine vocab_size in model_config.json)
In fact, the values of vocab_size in model_config.json, such as 48640 (= 2^9 * 5 * 19) and 99584 (= 2^8 * 389), can be factored into products of large powers of two and a few prime numbers.
I think this assertion should be removed.

Thanks for reviewing. I just changed the assertion to warning message. @so298


electron-reload

Add electron-reload for easier development.
I think I didn't use this before simply because I had multiple windows.
Now that its all one by all means add this.

added it by npm install electron-reload --save.
only had to require it in the main.js file.
now whenever you update any of the source code via alt + s the window quickly reloads the new changes just like a browser would.


use an aws role arn (irsa) while still loading the webIdenityToken from a file

When configuring an application with IAM roles for service accounts (IRSA) in a Kubernetes environment, you should not need to manually supply the Web Identity Token in your configuration. This token is dynamically generated and injected into your pod by the EKS environment.
The token should be loaded from a file.
https://github.com/kanisterio/kanister/blob/master/pkg/aws/aws.go#L132
I see that there is an option to load the webIdenityToken from a file, but that only works when configured using ENVs.
https://github.com/kanisterio/kanister/blob/master/pkg/aws/aws.go#L105
It should be possible to use an aws role arn (irsa) while still loading the webIdenityToken from a file.
My proposed solution is that instead of returning nil, nil when a webIdenityToken is not found, simply check to see if it's located at /var/run/secrets/eks.amazonaws.com/serviceaccount/token first.
https://github.com/kanisterio/kanister/blob/master/pkg/aws/aws.go#L126

In addition I think it would need to add the eks.amazonaws.com/role-arn annotation to the job.

cc @hairyhum

hi @clayrisser , I think I need your help to understand better the scenario being described here 😄
My question is whether or not the description below is the same set up that you are using? If not maybe we are missing a third use case!
TL,DR: checking for /var/run/secrets/eks.amazonaws.com/serviceaccount/token is done via env var AWS_WEB_IDENTITY_TOKEN_FILE if IRSA and Amazon EKS Pod Identity Webhook are set up
Long explantion:

When configuring an application with IAM roles for service accounts (IRSA) in a Kubernetes environment, you should not need to manually supply the Web Identity Token in your configuration. This token is dynamically generated and injected into your pod by the EKS environment.
The token should be loaded from a file.
https://github.com/kanisterio/kanister/blob/master/pkg/aws/aws.go#L132

You are absolutely right that when IRSA is used, there shouldn't be a need to manually supply for Web Identity Token because the token should be requested and stored by the kubelet on behalf of the Pod (src).
Additionally, if running on EKS clusters, the Amazon EKS Pod Identity Webhook watches for Pod that uses K8s Service Account annotated with eks.amazonaws.com/role-arn: arn:aws:iam::111122223333:role/my-role and injects several ENV_VAR into POD, including :
-AWS_WEB_IDENTITY_TOKEN_FILE that points to where the token file should be store, i.e. /var/run/secrets/eks.amazonaws.com/serviceaccount/token
-AWS_ROLE_ARN which is the AWS role that should be assumed. This is the same role that the K8s Service Account is annotated viaeks.amazonaws.com/role-arn
The scenario with Amazon EKS Pod Identity Webhook above is what the function fetchWebIdentityTokenFromFile accounts for. (Albeit that is actually not the best function name 😅 )
Which means the statement below is true, however the environment variables configuration part should be done by Amazon EKS Pod Identity Webhook on behalf of the Pod, and there should not be any additional work from user beside setting up (step 1, 2, and 3 here)

I see that there is an option to load the webIdenityToken from a file, but that only works when configured using ENVs.

Going back to the bugfix suggestion:

It should be possible to use an aws role arn (irsa) while still loading the webIdenityToken from a file.

This is entirely the intention of the caller function authenticateAWSCredentials

My proposed solution is that instead of returning nil, nil when a webIdenityToken is not found, simply check to see if it's located at /var/run/secrets/eks.amazonaws.com/serviceaccount/token first.

And checking for a token located at /var/run/secrets/eks.amazonaws.com/serviceaccount/token should be achieved with fetchWebIdentityTokenFromFile if the cluster and Pod are set up to use ISRA and Amazon EKS Pod Identity Webhook

Ok, so it works with irsa? Do you have any examples?

@clayrisser there are no examples to demonstrate this specific behaviour, but what you can do is to create a KubeTask function in your blueprint and specify podOverride there to contain serviceAccountName that you need:
- func: KubeTask
  name: examplePhase
  args:
    namespace: "{{ .Deployment.Namespace }}"
    image: busybox
    podOverride:
      serviceAccountName: my-serviceaccount
    command:
      - sh
      - -c
      - |
        aws sts get-caller-identity

If the pod is created in EKS and credentials injection is properly set up, you should get the role for the service account you're requesting.


Allow rook process and subset inside workflow - to work even if collection is the only input

Should not need to send:

time
level
area

@cehbrecht Please create 2 unit tests to assert that this will work:

as a direct call to Subset
as a Workflow

@cehbrecht Please create 2 unit tests to assert that this will work:

as a direct call to Subset
as a Workflow

See also PR #96


add new configSet signal to qcallback

Accidentally left out of #26

Codecov Report

Merging #28 (68f7a12) into main (716aacb) will decrease coverage by 0.62%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main      #28      +/-   ##
==========================================
- Coverage   94.28%   93.65%   -0.63%
==========================================
  Files          18       17       -1
  Lines         682      678       -4
==========================================
- Hits          643      635       -8
- Misses         39       43       +4

Impacted Files
Coverage Δ

pymmcore_plus/client/callbacks/qcallback.py
100.00% <100.00%> (ø)

pymmcore_plus/client/_client.py
90.21% <0.00%> (-3.27%)
:arrow_down:

pymmcore_plus/_serialize.py
98.33% <0.00%> (-1.67%)
:arrow_down:

pymmcore_plus/__init__.py

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 716aacb...68f7a12. Read the comment docs.

thanks!


import doesn't work if using contracts directory

With the default of putting contracts in ./contracts/, Solidity import command does not work:
solc --combined-json abi,asm,ast,bin,bin-runtime,clone-bin,devdoc,interface,opcodes,srcmap,srcmap-runtime,userdoc contracts/*
contracts/blobstore.sol:3:1: Error: Source "abstract_blobstore.sol" not found: File not found.
import "abstract_blobstore.sol";
^------------------------------^
contracts/blobstore.sol:4:1: Error: Source "blobstore_flags.sol" not found: File not found.
import "blobstore_flags.sol";
^---------------------------^
contracts/blobstore.sol:5:1: Error: Source "blobstore_registry.sol" not found: File not found.
import "blobstore_registry.sol";
^------------------------------^
contracts/blobstore_registry.sol:3:1: Error: Source "abstract_blobstore.sol" not found: File not found.
import "abstract_blobstore.sol";
^------------------------------^

prefixing import files with contracts/ fixes the problem, but I don't think this is the correct solution. It should not be necessary.

Yeah, local imports must start with ./ or ../ as per the solidity spec http://solidity.readthedocs.io/en/develop/layout-of-source-files.html
Cheers


UA typo fix (DEV)

changed "abrufen" to "abzurufen"

In my opinion,  it should also be "und andere zu warnen".
Or both like before: You can fetch your test result and can warn others.

In my opinion, it should also be "und andere zu warnen".
Or both like before: You can fetch your test result and can warn others.

What do you think @ChristinaTsigganos ?

In my opinion, it should also be "und andere zu warnen".
Or both like before: You can fetch your test result and can warn others.

What do you think @ChristinaTsigganos ?

Thank you very much for your contribution, @DerVogel2020! We've adapted the text to make it easier to read.


Easier Partial Downloading (FR)

Currently, you need to do 3 clicks to select files to DL
Click >  Priority > Do not download
You could make it easier to do Partial Downloading by:

implementing checkboxes like utorrent & transmission
https://www.simplehelp.net/images/utorrent/ut10a.jpg
https://www.simplehelp.net/images/transmission/tm03.png

Moving  "Do not download" up 1 level in menu hierarchy

+1

You can multi-select files in the list and set all of them to Do not download in one go, or you can select a folder (in case of a multi file torrent) and set the folder to Do not download. This will also set the files in that folder to Do not download.

There's now checkboxes in the list view when selecting files so I think it's quite straight forward to skip files now.


NEP: Contract Upgrade standard

Close https://github.com/neo-project/proposals/issues/135

According to NEP-1, maybe this can be an Informational NEP.

An Informational NEP describes a NEO design issue, or provides general guidelines or information to the NEO community, but does not propose a new feature. Informational NEPs do not necessarily represent a NEO community consensus or recommendation, so users and implementors are free to ignore Informational NEPs or follow their advice.

Mention _deploy method and the raised notification by the syscall?

Done.

@erikzhang @shargon Any other advice?


There is no way to refresh content

if I may, I agree with the fact it's problematic, the page should refresh when we surf from one tab to another in busy, or when we apply any change.
Can be confusing to save a signature, and not seeing it until F5 pressed, for example


Fallback to Client

Should APIClient not be available, fallback to alternative name. Makes
script more ressilient. Allows to check docker-py version from script.

docker.Client is only available in the old docker-py module, which is deprecated since 2017

You are hopefully aware, that nevertheless Ubuntu 16.04 is still active in the wild with that exact docker-py version.

checking the version of the docker module is already possible with exadt docker-version.

Sadly not. Currently it uses docker-py before logging versions. This patch makes docker_version work.

You are hopefully aware, that nevertheless Ubuntu 16.04 is still active in the wild with that exact docker-py version.

We do not support the deprecated docker-py module at all. In fact, we are using some features that are only available in recent docker versions. You can find the required version in our exadt_requirements.txt.
If your distribution does not provide the required version via their repositories, you can always install it using pip. If you need help with that, please refer to our README.


Issue 9537 - auto ref returns a reference its own stack

https://d.puremagic.com/issues/show_bug.cgi?id=9537

Superseded PR: https://github.com/D-Programming-Language/dmd/pull/4277


4.30.0 java.lang.NoClassDefFoundError

Search first

[x] I searched and no similar issues were found

Description
Just upgraded to 4.30.0 and when migrations run during tests, we get an exception and the process exits:
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/lang3/SystemProperties
 at liquibase.report.RuntimeInfo.<init> (RuntimeInfo.java:11)
    liquibase.report.UpdateReportParameters.<init> (UpdateReportParameters.java:15)
    liquibase.command.core.AbstractUpdateCommandStep.run (AbstractUpdateCommandStep.java:67)
    liquibase.command.core.UpdateCommandStep.run (UpdateCommandStep.java:100)
    liquibase.command.CommandScope.lambda$execute$6 (CommandScope.java:231)
    liquibase.Scope.child (Scope.java:203)
    liquibase.Scope.child (Scope.java:179)
    liquibase.command.CommandScope.execute (CommandScope.java:219)
    liquibase.Liquibase.lambda$update$0 (Liquibase.java:216)
    liquibase.Scope.lambda$child$0 (Scope.java:194)
    liquibase.Scope.child (Scope.java:203)
    liquibase.Scope.child (Scope.java:193)
    liquibase.Scope.child (Scope.java:172)
    liquibase.Liquibase.runInScope (Liquibase.java:1329)
    liquibase.Liquibase.update (Liquibase.java:205)
    liquibase.Liquibase.update (Liquibase.java:188)
    liquibase.Liquibase.update (Liquibase.java:175)
    io.zonky.test.db.postgres.embedded.LiquibasePreparer.prepare (LiquibasePreparer.java:72)
    io.zonky.test.db.postgres.embedded.PreparedDbProvider.createOrFindPreparer (PreparedDbProvider.java:85)
    io.zonky.test.db.postgres.embedded.PreparedDbProvider.<init> (PreparedDbProvider.java:64)
    io.zonky.test.db.postgres.embedded.PreparedDbProvider.forPreparer (PreparedDbProvider.java:59)
    io.zonky.test.db.postgres.embedded.PreparedDbProvider.forPreparer (PreparedDbProvider.java:55)

This is working fine in 4.29.2. Any ideas? Or please send me over to zonky if you think that is where the issue comes from 😁
Steps To Reproduce

Running tests in a leiningen (clojure) project.
On startup of the tests, we start a zonky embedded postgres instance
Then run migrations with the class io.zonky.test.db.postgres.embedded.LiquibasePreparer

Expected/Desired Behavior
Migrations complete and tests start.
Liquibase Version
4.30.0
Database Vendor & Version
io.zonky.test/embedded-postgres "2.0.7"
Liquibase Integration
zonky
Liquibase Extensions
none
OS and/or Infrastructure Type/Provider
OSX
Additional Context
No response
Are you willing to submit a PR?

[ ] I'm willing to submit a PR (Thank you!)

Hi @jakepearson !
Seems you need to add  commons-lang3 a dependency to your application. Would you be able to test it?

Thanks @filipelautert that solved the issue (I thought of it but forgot to mention it above 😁). I can add the commons dep to my projects, but instead should liquibase automatically pull it in?

Hm.... but i can see it here .  And when checking dependency tree in maven as below it shows up too, maybe you have an exclusion for that somewhere (or zonky has it)?
[INFO] \- org.liquibase:liquibase-core:jar:4.30.0:compile
[INFO]    +- com.opencsv:opencsv:jar:5.9:compile
[INFO]    +- org.yaml:snakeyaml:jar:1.30:compile
[INFO]    +- javax.xml.bind:jaxb-api:jar:2.3.1:compile
[INFO]    +- org.apache.commons:commons-collections4:jar:4.4:compile
[INFO]    +- org.apache.commons:commons-text:jar:1.12.0:compile
[INFO]    +- org.apache.commons:commons-lang3:jar:3.12.0:compile
[INFO]    \- commons-io:commons-io:jar:2.17.0:compile

Good question. I'll take a look in the zonky pom.

That was it. The versions are different in the 2 poms. I created a PR on zonky. https://github.com/zonkyio/embedded-postgres/pull/139
Thanks!


 We remove the build args for making sure that such a thing cannot happen anymore
furthermore, we flexibilize some workflows such that they can be manually triggered with options and such that they can be debugged on development repos for future releases.
Implements a lacking code path/shortcut when interacting with the DelegationService.
Tests the lacking code path.
WHY
Currently, there is no working docker image in the official dockerhub repo.
#69
FURTHER NOTES
Closes #46
Closes #69

LGTM, but I've ran dash tool on PR source (catenax-ng/tx-knowledge-agent-edc main branch) and I've determined changes in DEPENDENCIES file, which are not part of this PR. Please update DEPENDENCIES file and add to this PR.
After DEPENDENCIES has been updated, I'm fine to merge the PR.

DEPENDENCIES updated, still approved from what I saw. Sorry for mixing that bugfix into the PR, we will try to work on branches rather than main in the future.


[WIP] investigate: cythonize under win32

Pull Request Test Coverage Report for Build 587

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 98.522%

Totals

Change from base Build 585:
0.0%

Covered Lines:
600

Relevant Lines:
609

💛  - Coveralls

Pull Request Test Coverage Report for Build 587

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 98.522%

Totals

Change from base Build 585:
0.0%

Covered Lines:
600

Relevant Lines:
609

💛  - Coveralls

It was a debugging-only


[1.18.2] Issue Title missing content

missing multiple items from the mod, washing factory doesn't work, liquid meat ores not working

I think that got fixed at some point


Default Conflict Resolution isn't set from start

Storage Explorer Version:
Platform/OS Version: Windows Server 2012 R2 (win2k12 r2)
Architecture:  VM on vmware - Xeon CPU E5-2670 2.6GHz
Regression From:
Steps to Reproduce:

Drag and Drop a folder onto ASE

Expected Experience:
To be asked what to do with conflicts OR to allow a global setting of conflict resolution (overwrite, skip etc).
Even better would be to have a resume prior copy feature as this is primarily when this issue arises i.e. after a lockup and you have to restart the copy but don't want to have to recopy 40 GB of data
Actual Experience:
Copy starts and immediately failures start piling up. You need to quickly click on conflict resolution mode and select a mode. Often, this stops progress on transfers.

If I understand the details correctly, you're running Storage Explorer in a VM running on Windows Server? That can make network connections complicated.

What version of Storage Explorer are you running?
Are you uploading from a local FS to blob storage or a file share?
Have you tried other operations to make sure they work?
Does this work for smaller operations, such as for smaller or fewer files?
What if you start the upload from the toolbar instead of dragging and dropping?

ASE v 1.3.1 is used. The VM has mounted network storage (local NAS) and we are copying from there to ASE folder (file share) storage. It has worked for smaller copies. 5/6 copies have worked fine. All copies were folders containing 5000 folders and 10000+files in those folders. The one that fails is far larger than the others. The 5 that worked were 9-40GB and the failing one is 270GB.
On my 3rd attempt with this, it is still running but having to answer questions during the process is very undesirable as you want it to run unattended. It asks about retries and conflicts (Auto-resolve behavior). If I could set these globally prior to transfer ti would run unattended. I realize I can set Auto-resolve behavior once the copy has started but AES seems to have issues when it has conflicts before you set this. So, when I have transferred 30GB and it fails and locks, I have to start from the beginning because it stalls if I try to restart and set the Auto-resolve behavior to Skip.
I tried the toolbar upload and it works for small new uploads but it had the same result with a restart upload - possibly even worked worse. Even if the setting wasn't globa - if you could select the Auto-resolve behavior on the upload panel where you select the folder (from toolbar) - that would be an improvement.

I agree we can add a default conflict resolution option before the operation starts. We'll note that going forward.
Just to be clear, does setting the auto-conflict resolution work?
Also, I still don't know what your source/destination environments are. We've made some performance improvements for Blob downloads and uploads but we're still working on File shares. Are you copying Blob→Blob? Blob→File? Local→Blob? File→Local? Knowing exactly what you're trying to do will help us improve the right components.

#response_container_BBPPID{font-family: initial; font-size:initial; color: initial;}  I'm going to file shares on Azure. The auto settings work but if enough errors kick in before you set it, it stalls                                                                                Sent from my BlackBerry - the most secure mobile device - via the Rogers Network                                                                                From<EMAIL_ADDRESS>August 3, 2018 2:05 PMTo<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>Re: [Microsoft/AzureStorageExplorer] Default Conflict Resolution isn't set from start (#539)  I agree we can add a default conflict resolution option before the operation starts. We'll note that going forward.
Just to be clear, does setting the auto-conflict resolution work?
Also, I still don't know what your source/destination environments are. We've made some performance improvements for Blob downloads and uploads but we're still working on File shares. Are you copying Blob→Blob? Blob→File? Local→Blob? File→Local? Knowing exactly what you're trying to do will help us improve the right components.
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or mute the thread.

To further clarify, we were migrating on premises servers to Azure, so a pretty typical and desirable circumstance for Azure. The on premise servers are w3k12 VM in a vmware environment. The storage is on a NetApp NAS which we mounted on one of the servers. We used ASE to drag the folders to an Azure File Share (not Blob)

If you're working on a migration project, I would consider some of the suggestions I made in #540. Either use the Connect VM button to get a command for mounting the file share to a drive letter or use AzCopy to copy your files using the command line. Although we're constantly trying to improve performance in Storage Explorer, you may find these options easier and more performant.

@jim-jezioranski We have designed a different experience together with the AzCopy integration for data transfers for blobs in our recent releases. If there is conflict, we would pause on those files with conflicts and prompt a dialog for you to choose the resolution type. All files without conflicts will be transferred in the background. In our next release v1.13.0, the same experience will be introduced to file share as well so that you won't need to answer the awkward "Auto-resolve behavior" during the upload/download/copy&paste.
Please let us know then if you have any issues with the new experience.

Closing due to lack of response. Please open a new issue if you aren't happy with the conflict experience in 1.13. Thanks.


tests: Use logcat for output on Android

Use the following to see output when using the APK:
adb logcat | grep VulkanLayerValidationTests
Printfs still won't show up, but this should give a
better idea of how things are running on production
devices, including when a test hangs or crashes.

cherry-picked to master


Docker image

Are there plans of publishing a docker image so its easier to check out without having to clone the project?

Multiple images can't be run with a single command in Docker and it would be really hard for users to configure things in the command and there would be lots and lots of issues regarding that so I've just made the compose file that has the configurations and everything you need to setup the containers.

@ItzCrazyKns but then it becomes harder to stay up to date having cloned the repo but also making changes to the docker-compose etc, specially for homelab users then its about managing git modules.
I think the config.toml file can probably be swapped or extended with environmental variables as well in here:
https://github.com/ItzCrazyKns/Perplexica/blob/master/src/config.ts#L34-L53
Im happy to help with a PR if needed


How to get starting and ending index of successfully parsed expression?

Hi, I am trying to use fastparse to parse torrent files. I need to generate the info_hash which is the SHA1 of the info dictionary. I need the start and end file offsets in order to do this. What would be the easiest way to do this? Is instrumentation the only method?
Thanks! (great library btw!)
EDIT: I'm using the ByteApi if it makes a difference

Nevermind, I guess I should use Index!


Set status.observedGeneration for federated resources

Set status.observedGeneration for federated resources to provide an indication of whether the sync controller has processed the current state of resource.

Rebased and ready for review

Rebased

Rebased and updated to address comments.


Need to click editor twice to begin typing

Describe the Bug
When changing focus to another program and then returning to Beaker, the editor isn't editable until a subsequent click has been performed.
To Reproduce

Launch Beaker
Open the editor
Begin typing in the editor
Launch any other program (i.e. Notepad)
Position the other program's window so that you can still see the Beaker editor (but leave this other window focused for now)
With the other window still focused, click the Beaker editor where you would like to begin typing
Start typing: nothing happens
Click the same place in the editor again
Start typing: now text comes out

Expected Behavior
Clicking the editor while Beaker isn't focused should both bring Beaker to the front (works correctly) and make the editor ready to accept keystrokes (does not work).
Environment

OS: Windows 10
Beaker Version: <IP_ADDRESS>

Fixed in the next release


Use  for thumbnails

Hello, it's me again ! 😆
Let me summarize : In the PR #16, I proposed my thumbnail generation system, in order to optimize the page loading. The problem with this system is that the thumbnails were also displayed in the RSS or Atom feed aggregators. So in the PR #25, I proposed to disable the caching of the page in order to generate a special version without thumbnails for the feeds.
But I don't like this solution. It's a hack, and weakens Grav's biggest strength : Caching. The ideal solution would be to generate thumbnails for browsers, while keeping the original image in the "src" field for aggregators. Where I was stupid, is that this solution already exists in HTML5 : It's the "srcset" attribute of the "img" element !
The problem with this attribute is that the browser chooses the resolution to load, and it depends on the pixel density of the device (DPR). So I decided to generate two thumbnails: One for devices with DPR=2, and one for DRP=3. The ones above will load the original image.
There are also some problems with Justified Gallery which does not support "srcset", I let you look at my commits for more technical details.
By the way, I left the functionality to not generate the gallery in the feeds when caching is disabled, because it's still nicer and cleaner, but I no longer encourage the user to disable caching just for that.
Anyway, it is increasingly complicated, if you do not want to merge this PR, I understand perfectly.
Have a nice day ! 😀

Edit : Please don't merge this yet, I want to test something else. Too much ideas in my brain. 😅

Okay, I think it's good, and I don't think we can do better. I tried to tweak something with thumbnailPath and lazy-loading, but it doesn't work, the browser always loads the images before Justified Gallery initializes. And anyway I think it would be a bigger hack than what I propose here with srcset. So I'll leave it at that. ^^
After that, I'll have another PR to finish what I did at PR #17 : It will move the JS code inline at the bottom of the HTML, as it was in your original version. ;)

I didn't know it did that...

Thanks for your outstanding work!
Gladly merging this. ❤

Thanks, and your welcome ! ^^


refactor SingleEntryDependency to es6

What kind of change does this PR introduce?
refactor
Did you add tests for your changes?
current tests should pass
If relevant, link to documentation update:
N/A
Summary
upgrade SingleEntryDependency to es6
Does this PR introduce a breaking change?
No

Thank you!! Getting closer :-D


chore: run windows build on CI

Summary
🤞
Appveyor is super slow, and on a private account, so we can't cancel redundant builds there. And going from 3 to 2 CIs is only positive.
We might consider adding osx as well, so we have Circle for testing different versions of Node, and Travis to test different OSes.
https://blog.travis-ci.com/2018-10-11-windows-early-release

Test plan
Green!

Changleog maybe?

You can also remove appveyor bits from testSetupFile.js

You can also remove appveyor bits from testSetupFile.js

Great call!

@Daniel15 do you need to remove Jest from your projects or will it be done automatically after we merge this PR? (The builds still trigger even though we removed config)

Might need a repo admin to remove the webhook from settings?

do you need to remove Jest from your projects or will it be done automatically after we merge this PR?

I'm not actually sure. I think an admin of this repo needs to remove the webhook that pings AppVeyor whenever a new PR is opened / commit is made. I'm not an admin so I can't do that.

Hmmm, python is supposed to be there...
https://docs.travis-ci.com/user/reference/windows/#pre-installed-packages
https://travis-ci.org/facebook/jest/jobs/443322251#L141

This is unfortunately blocked for now on https://github.com/nodejs/node-gyp/issues/1568 (not node's fault, but easier to link there than the community thing travis uses)

@Daniel15 while this PR is blocked, just one last question (sorry for pinging twice 😅) – is it possible for you to automatically cancel previous builds on AppVeyor so they don't queue up unnecessarily? This is our main source of pain right now when testing on Windows.
Based on their docs it's possible to set "Rolling builds" from settings UI: https://www.appveyor.com/docs/build-configuration/#rolling-builds

@thymikee  No worries. I just enabled the "rolling builds" option. Feel
free to ping me again if there's anything else you'd like me to change.
Regards,
Daniel Lo Nigro
https://dan.cx/ | Twitter http://twitter.com/Daniel15 | Facebook
http://www.facebook.com/daaniel
On Sat, Oct 20, 2018 at 5:11 AM Michał Pierzchała<EMAIL_ADDRESS>wrote:

@Daniel15 https://github.com/Daniel15 while this PR is blocked, just
one last question (sorry for pinging twice 😅) – is it possible for you
to automatically cancel previous builds on AppVeyor so they don't queue up
unnecessarily? This is our main source of pain right now when testing on
Windows.
Based on their docs it's possible to set "Rolling builds" from settings
UI: https://www.appveyor.com/docs/build-configuration/#rolling-builds
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/facebook/jest/pull/7211#issuecomment-431574780, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFnHa22AZ8dMqehV0d_dv9vLIUYBsA7ks5umxLbgaJpZM4Xt8Nh
.

Ok, managed to install python and get it added to $PATH. Next issue is that we seem to have lost colors (supports-colors probably returns false because of reasons), so many tests are failing...

Should not be hanging after the last commit, but we are still missing colors...
What about using azure pipelines? Like https://github.com/prettier/prettier/pull/5410

What about using azure pipelines? Like prettier/prettier#5410

Azure Pipelines has support for junit test reporting (as you might've seen prettier use). You can also build on Mac and Linux in addition to Windows, so you could use Azure Pipelines to test OS's and Circle for versions of Node. That said, if you're inclined to move everything to one CI service, Azure Pipelines can test across Node versions too, and we'd be happy to give you additional concurrency. Let me know if you have any questions or suggestions. I'm a Program Manager on Azure Pipelines and happy to help!

We've been working on moving the Yarn build to Azure Pipelines too :) Seems like a good service.

I'm +1 for moving to azure instead 😸

Yeah, my vote is for Azure pipelines as well. We don't run Travis on master since colors are messed up, which means we'd not be running windows on master, which I don't think is acceptable.
@kaylangan What's the easiest way forward? I'm not an admin on this repo, is that needed?

you could use Azure Pipelines to test OS's and Circle for versions of Node

That sounds perfect, at least to start with 🙂

@SimenB I've created #7556 that will add initial support for Azure Pipelines. You will need repo permissions to set up the Azure Pipelines GitHub app.


Configuration reset

Hello.
When I change configuration of pex it resets. Also when I try to change beckend it resets to default permissions.yml and resets all permissions. In past it has worked properly.
My pex version is 1.23.4 and server version is Spigot-1.12.2.

PEX 1.x is no longer supported.


Add become in bootstrap-hypervisor.yml

Let's not assume it is possible to login as root.
Add's "become: true" to the tasks that require priviliges.
As a pull request owner and reviewers, I checked that:

[X] No actual test for that playbook - it's provided as an extra.

/approve
/lgtm


Follow up cleanups for file system watching

Some improvements left over from https://github.com/gradle/gradle/pull/13975.
Fixes gradle/gradle-private#3167

@bot-gradle test QFL

OK, I've already triggered QuickFeedbackLinux build for you.

@lptr PTAL!

@bot-gradle test QF

OK, I've already triggered QuickFeedback build for you.

@lptr PTAL!


[Word] Clean up references to retitled articles

Docs Build status updates of commit 9e9afda:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/develop/support-for-task-pane-and-content-add-ins.md
:white_check_mark:Succeeded
View

docs/reference/overview/word-add-ins-reference-overview.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Bug in v0.11.0: undefined macro method 'NilLiteral#args'

I discovered this bug while trying to use Rosetta v0.11.0 on a fresh shards install and a simple sample Kemal app:
Crystal 1.8.2 (2023-05-09)

Using rosetta (0.11.0)
In src/app.cr:18

 18 | require "../config/rosetta"
      ^
Error: while requiring "../config/rosetta"

In config/rosetta.cr:8:18

 8 | Rosetta::Backend.load("./config/rosetta")
                      ^---
Error: expanding macro

In lib/rosetta/src/rosetta/backend.cr:70:60

 70 | rules = Rosetta.annotation(Rosetta::FallbackRules).args.first ||
                                                         ^---
Error: undefined macro method 'NilLiteral#args'

Note that when downgrading to v0.10.1 it works just fine.

Thanks for reporting! I just pushed v0.11.1 with a fix for the issue.
Please let me know if there's anything else.

Feel free to reopen if something else pops up.

You're welcome! 🙂


[Feature]: Call operator static method without init args

Is there an existing issue for this?

[X] I have searched the existing issues.

Is your feature request related to a problem? Please describe.
Can we call a static method from a towhee operator without initialization the op? Check example op below:
class ExampleOp(NNOperator):
    def __init__(self, model_name='model1'):
        self.model = create_model(model1, pretrained=True)

    def __call__(self, x):
        return self.model(x)

    @staticmethod
    def supported_model_names():
        return ['model1', 'model2', 'model3']

With example op above, how can I call op.supported_model_names() without loading any model? I tried current methods and it always initialize op:
from towhee import ops

op = ops.name_space.op_name().get_op()
op.supported_model_names()

Describe the solution you'd like.
Get op static call without initializing the op module.
Describe an alternate solution.
No response
Anything else? (Additional Context)
No response

Not easy to support it, and it is not in the plan.


Link to MS Mechanics YoutTube video not working

Link does not work:
Watch this video for an introduction to Encryption in Office 365.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 21613e57-8909-5adc-26ea-14e0a4771d3b
Version Independent ID: dcd08c8d-4786-abbd-bd9d-47ad6d2117e6
Content: Email encryption in Microsoft 365 - Microsoft 365 Compliance
Content Source: microsoft-365/compliance/email-encryption.md
Service: o365-seccomp
GitHub Login: @KCCross
Microsoft Alias: krowley

@M1KK3Lz Thank you for your feedback. We have made changes to the document via PR#https://github.com/MicrosoftDocs/microsoft-365-docs/pull/5044. Please note that the video link is removed as it is unavailable/private at the moment.
Thanks
Sri

@msbemba Thank you very much for the contribution and updating the documentation with PR. @M1KK3Lz Hope this update is helpful for you. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


CAMEL-14910: Bundling of the heavily distributed components

Particular queries were raised in this issue.

Should there be summary pages for groups of related components?
There already existed summary pages for groups including Ignite, Spring, and a few others. However, as this brings in clarification to understand the documentation, I also added a summary for other groups including AWS, AWS 2, Google.

What should their structure and appearance be?
In the nav panel, I believe that the highly distributed related components should be bundled and grouped together within the parent component.

Should the nav pane indent the components in a group?
As for user manual documentation under camel Kafka and others, the nav pane is well indented with subgroups and parent groups. Thus, it has been done in the same manner for this PR.

As reported in this file:
// this file is auto generated and changes to it will be overwritten
// make edits in docs/*nav.adoc.template files instead
The list of components is autogenerated, so this update will be lost at the first rebuild.

Sir, I made the changes in the docs/components/modules/ROOT/nav.adoc file itself to nest the related components together.

Yes, but since this file is autogenerated on each camel build, your update will be lost at first rebuild. So actually this cannot be merged.

Yes, but since this file is autogenerated on each camel build, your update will be lost at a first rebuild. So actually this cannot be merged.

Alright understood, but you specified edits could be done on nav.adoc.template files, however, I am unable to find them on the repo.

That's the comment reported there. Grouping the aws2, google etc component, requires to modify the way the nav.adoc is generated.

That's the comment reported there. Grouping the aws2, google etc component, requires to modify the way the nav.adoc is generated.

I edited the .adoc.template file related to the component nav.

Is this groping happened manually? I mean how did we determine these are related components? If yes, wouldn't makes sense to generate these data programmatically? I think at some point we will lose track of maintaining such list :)

@omarsmak They have the initial starting as in for related components, let's say ignite all the naming is done as per ignite- component name. This is how the relativeness was determined based on the naming of the files.

@AemieJ is great to hear that, my question was actually, does already generate the groupings programmatically or you have to create the grouping templates beforehand?

This patch doesn't work.  The template does not need to be changed, only the generation code in gulpfile.js.
It's unfortunate that jira is so loosely connected to GitHub.  On the Jira issue I suggested a "depth" attribute in the page to determine the nesting depth.  I don't see a way to generate this automatically and reliably. Any other ideas?

This patch doesn't work. The template does not need to be changed, only the generation code in gulpfile.js.
It's unfortunate that jira is so loosely connected to GitHub. On the Jira issue I suggested a "depth" attribute in the page to determine the nesting depth. I don't see a way to generate this automatically and reliably. Any other ideas?

I didn't see the reply on Jira, sorry about that, I provided an idea to nest them using depth on Jira. I believe it's best to include a summary for all the relative components, some of which I have written. I will revert back the template.adoc.

Well, I didn't notice the jira issue is closed:-)  Lets discuss this here.
I think your idea of computing using the names will work.  However, I would prefer that the information used to structure the generated lists be available as attribute data.  I think this will make it easier to understand what is happening and more useful for reuse.  For instance, I would like to have the lists of components on the summary pages generated as well.
What if the subsidiary component pages have a "group" attribute, and the summary pages have a matching "summary-group" attribute.
For Ignite:

summary page:

:summary-group: ignite

each ignite component page:

:group: ignite

I think the summary indexes could then be generated with
indexList::[attributes="group={summary-group}"]

I guess the gulpfile would need to be a little more complicated as it would need to read the first few lines of each adoc and at least partially parse the attributes.

The attribute naming could be used to even link back and forth on the pages as well. Apart from that, I came up with the basic logic to use the file path and title for createComponentNav() function in gulpfile.js. SummaryTitle is an additional variable I assigned.

Well, I didn't notice the jira issue is closed:-) Lets discuss this here.
I think your idea of computing using the names will work. However, I would prefer that the information used to structure the generated lists be available as attribute data. I think this will make it easier to understand what is happening and more useful for reuse. For instance, I would like to have the lists of components on the summary pages generated as well.
What if the subsidiary component pages have a "group" attribute, and the summary pages have a matching "summary-group" attribute.
For Ignite:

summary page:

:summary-group: ignite

each ignite component page:

:group: ignite

I think the summary indexes could then be generated with
indexList::[attributes="group={summary-group}"]

I guess the gulpfile would need to be a little more complicated as it would need to read the first few lines of each adoc and at least partially parse the attributes.

Within each summary.adoc file that's already present, the sub-components that are listed are written manually aren't they?

At the moment, yes, and IIRC in lots of different styles.  I think it would be nice to generate those lists, which I think is possible with the attributes as I suggested.
Please quote text rather than using screenshots :-)

At the moment, yes, and IIRC in lots of different styles.  I think it would be nice to generate those lists, which I think is possible with the attributes as I suggested.
Please quote text rather than using screenshots :-)

I am sorry for the screenshot, it was just a method that could be used to generate the nav file for component. I will push the commit, for the change in gulpfile.js I made.

I appreciate you showing your code, but please use markdown on text; surround the text with ```.
Your code looks like it would work, but I think it is rather fragile.  Perhaps we need some more opinions.

Yes, but for now, I could observe this pattern and come up with this solution. If an another method strikes me, I will discuss it here.
I will push my code as of now.

I appreciate you showing your code, but please use markdown on text; surround the text with ```.
Your code looks like it would work, but I think it is rather fragile. Perhaps we need some more opinions.

@djencks , as the summary method is fragile, we could use the attribute naming that you suggested. What we could do is as each component is manually written and each has constant variable declared as docTitle, what we could do is divide files into parentGroup and childGroup variables, and check whether it is parent attribute or child using the following logic.
function isParentAttribute(file) {
    var attributeName = /(?::parentGroup: )(.*)/.exec(file.contents.toString())
    if (attributeName != null) {
        return attributeName[1];
    }
    return null;
}

function isChildAttribute(file) {
    var attributeName = /(?::childGroup: )(.*)/.exec(file.contents.toString())
    if (attributeName != null && attributeName[1] == parentAttribute) {
        return true;
    }
    return false;
}

Then while the distribution logic takes place to generate the adoc file, we could use the following logic of if and else:
if (isParentAttribute(file) != null) {
     parentAttribute = isParentAttribute(file);
} else if (isChildAttribute(file)) {
     return `*** xref:${filepath}[${title}]`;
}
return `** xref:${filepath}[${title}]`;

With this manner, it would be accurate and the code will never fail for any test. This method works as I tried it on my code editor. If you like this, we could follow up with this.

That's the solution I was trying to suggest, except you've renamed the attributes I proposed:
summary-group > parentGroup
group > childGroup

I think my names suit the situation marginally better, but don't have a strong preference.
I'm not sure but think that it's more common to use dashes than camel case in asciidoc attribute names. Either will work.
Thanks!

Fine I will rename those attributes, it helps with understanding the definition better but this idea of yours to use attributes  seems much better and reliable way to generate. 👍

@djencks For providing the attribute for the ones with relative groupings, the docs pages within the docs/components is auto-generated from the src files in components folder, right?

Yes. The files in docs/components should have an attribute indicating exactly where they come from, in components.

@djencks I have included the attributes for the related files within the components/src folders and modified the gulpfile.js, check it out.

The code modifications look good, but I didn't try building it.  A couple of minor comments:

it might be worth reading each file only once and extracting both parent and child attributes at once, returning them in an object or array.

I'm not sure if deleting the AWS, AWS2 and google pages is a good idea.  It might be better to turn them into real summary pages, at least with an index list.

With this I think we'd be set for generating an index list on the summary pages.  Would you like to do that or would you prefer I do it?

About the first point, in the gulpfile, the file is generated one by one, and hence I read that turn by turn to check whether they are either the parent or child attribute.
Yes, I do want to include aws, aws2 and Google summary pages, it's just modified them within the docs/components inspite of the components folder. I will do that.

I think for files that are not summary files, your code reads the file twice, first to determine it's not a summary page, and second to determine if it is in a group.  You could read the file once and apply both regex to determine both properties.

There needs to be a blank line after the header attributes before any content.  I think you removed this in some of the group files.

I think the changes to the group files are going to be overwritten when a java build is done.  We probably have to find a way to generate the group attribute from somewhere earlier.  I'll think about this.

I realized, I made the mistake for two of the group files and omitted the space.
About your third point you mentioned, I made changes to the files within the components src folder, which is the original source code for each documentation, right?

@djencks I modified the gulpfile to include checkAttributeExistence() and thus it resulted in removal of isChildAttribute() function as it isn't required based on the logic then and I modified the two adoc files where I removed the space. It feels right now, what do you think?

You are still reading the file twice sometimes.  I was thinking of replacing

if (summaryGroup != null || group != null) return true;
     return false;

with
return {summaryGroup, group}

Then you can test groupInfo.summaryGroup and groupInfo.group.

Modifying the files in components/../src is better than  in docs/components/... but those files are partly generated as well, and I think the header attributes are currently  entirely generated, so your changes may get overwritten.  I think we can tweak the attribute generation to preserve specific attributes, including "group".  Otherwise we can find a way to generate this attribute as well.  The code is in tooling/maven/camel-package-maven-plugin/src/main/java/org/apache/camel/maven/packaging/UpdateReadmeMojo.java in the updateHeader method.  I think I see how to do this, so unless you are eager to work on this code I'll fix it in a separate PR. Let me know.

I think having the summary pages you mention will be a good idea, but there should probably be some description of the group, which I'm not qualified to write.  Let's add them and ask for someone to add some descriptive text. However, I think it would be better to add them in the PR for generating the index list on these pages.

Alright, I got what you meant, it wasn't clear from before. I will include the summary pages with basic styling as the other summary pages as of now to maintain the listing.

See, we used summary and group majorly for index listing in future so we could auto generate the list in summary group, so while checking you just required the need for childAttribute and provide a depth of 3. All rest will require a depth of 2.
Also, for adding those additional summary pages, I will do as of now to include the layout similar to other summary pages just for bringing the relativeness in the picture.

I wrote https://github.com/apache/camel/pull/3876 which provides the functionality needed so your manual changes won't get overwritten by the java build.  I tried it on "ignite" in your branch and it appears to work properly.  I'm not sure how to integrate all of this.  You might cherry pick my commit to your branch. You should then run the java build to get the updated component .adoc files and check that they look right and work with your gulp file change. Thanks!

@djencks  While using the changes you made in your code, I ran mvn compile, it is failing to build as there is no plugin descriptor
org.apache.maven.plugin.PluginDescriptorParsingException: Failed to parse plugin descriptor for org.apache.camel:camel-bundle-plugin:3.4.0-SNAPSHOT
No plugin descriptor found at META-INF/maven/plugin.xml

@djencks I ran mvn compile and I ran into a couple of errors which then resulted in a couple of git errors so I re-created the PR.


[FIX] Dynamic batching window for redeeming does not change

Release 0.9.4
[2023-11-18 15:35:17,500] [ERROR] [agent] The RPC timed out! This usually happens if the filtering is too wide. The service tried to filter from block 30237353 to 30242353.If this issue persists, please try lowering the EVENT_FILTERING_BATCH_SIZE! [2023-11-18 15:35:17,500] [WARNING] [agent] Repeating this call with a decreased batch size of 2109. [2023-11-18 15:36:09,129] [ERROR] [agent] The RPC timed out! This usually happens if the filtering is too wide. The service tried to filter from block 30239462 to 30244462.If this issue persists, please try lowering the EVENT_FILTERING_BATCH_SIZE! [2023-11-18 15:36:09,129] [WARNING] [agent] Repeating this call with a decreased batch size of 1582. [2023-11-18 15:37:00,864] [ERROR] [agent] The RPC timed out! This usually happens if the filtering is too wide. The service tried to filter from block 30241044 to 30246044.If this issue persists, please try lowering the EVENT_FILTERING_BATCH_SIZE!
Error message states the window batch size is getting smaller but the distance between the blocks reported stays constant to 5000.

The batch_size is currently (after #149) not persisted across rounds. This should be added imo to avoid going back to large badges on each round entry.


select menu option needs the header and footer slots

This function solves the problem (这个功能解决的问题)
custom the actions like fuzzy search in  options
Expected API (期望的 API)
footer slot
header slot
deprecated
action slot

For fuzzy search you should use filterable.

For a header slot, you need to convince me it is quite needed with some example.

something like this, submenu added a search function which should be setted into header slot

Why not using filterable?


Question: Is there parity between Spinnaker versions and Kubernetes?

Page: /community/releases/versions/
Feedback:
Is there parity between Spinnaker versions and Kubernetes?  i.e. Spinnaker v1.14.x for Kubernetes 1.14, and upgrading to Spinnaker 1.15 when we upgrade Kubernetes to 1.15 etc

The similarity in the versions is purely coincidental.


AADSTS50020: User account<EMAIL_ADDRESS>from identity provider 'live.com' does not exist in tenant 'Deftsoft' and cannot access the application 'b3331153-e8ba-43f8-8b53-2c4a80df089f' in that tenant. The account needs to be added as an external user in the tenant first. Sign out and sign in again with a different Azure Active Directory user account.

First time this solution was running then it gave db network instance error then i Attached the db given in solution in sql server 2014 then when i run the solution after authentication it gives below error -
AADSTS50020: User account<EMAIL_ADDRESS>from identity provider 'live.com' does not exist in tenant 'xxxxx' and cannot access the application 'xxxxxxxx-xxxx-xxxx-xxxx-2c4a80df089f' in that tenant. The account needs to be added as an external user in the tenant first. Sign out and sign in again with a different Azure Active Directory user account.

I have not bought any subscription from azure I am currently using Free Outlook and Office365 Account


1.32.0 is broken for Mac OS

Version 1.32.0 does not work at least for MacOS 14.3.1,

The exact same error occurs for all the commands

This would happen if the server has not been activated yet. If you open a Luau file, what is the output in output window for Luau Language Server?

There's nothing here if this is what you meant:

Strange how it is not getting detected, but the luau file icons are changed. I'm not sure why your extension is not getting activated. There may be some relevant logs in one of the output channels.
Can you also check the developer console? It is possible the JavaScript portion of the extension errored out

The Icons are assigned by the Rojo extension, sorry about that.

Yeah it does seem to be the javascript.
If you need the full log, here it is:
log.txt

What is your VSCode version? Also if you can go to the about VScode page can you check the version of Node.js?

Here it is:

Alright, so I fixed the issue. It was probably just outdated Node.js or outdated VS Code, so I updated and it fixed everything.
Here's the version now:

As always, thanks for your help!

Yeah we need Node v18+. I'll look into increasing the minimum node requirement in the extension config


Rotation of Doubly LinkedList by the given node

Have you read the Contributing Guidelines on Pull Requests?
yes
Description
Given a doubly linked list, rotate the linked list counter-clockwise by N nodes. Here N is a given positive integer and is smaller than the count of nodes in linked list.
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests
#5447

@anushkrishnav  please merge it also ,as you have added label but didn't merged it .

Hi @anshmishra010
Thanks for your contribution!
You have been a valuable contributor to NeoAlgo during GirlScript Summer of Code '21 and we respect your contributions and endeavors.
However lately the turn of events has not been in favor of either of us. We have found you violating a lot of rules and guidelines recently.  In our Contributions Doc here, we clearly mentioned that no help or assistance should be asked over ‘Direct Messages’. All assistance and help should be communicated over the apt channels (Slack/Github/Discord).
We have found instances where you have contacted the Mentors on a personal basis, through Phone Calls and WhatsApp. We have found that this behavior is totally unacceptable and not conducive for any Open-Source community to smoothly function.
As a Contributor, you should realize that Mentors are busy people and are usually taking sometime out every week to help you with the contribution process. Sending them messages and calling them, on personal channels, is unsolicited and displays brash behavior and outlook towards contributing to Open Source.
After considering all these points, and a mutual discussion between all the mentors, we have collectively decided to ban you from the organization and nullify all your points that you worked on during GSSoC. Please note, that this decision cannot be appealed against and won't be reverted in any situation or condition.
We would consider having you contribute to other organizations and help build awesome Open-Source projects. We would be also happy to assist you in getting started with other Open-Source Projects. We look forward to your future endeavors.
Best Regards!


weird characters in SongBeamer_OSC.docx

In documents/SongBeamer_OSC.docx in columns Action, Feedback and Status are wired characters.
SongBeamer_OSC.pdf

@nugatritter thanks for reporting - for some reason WebDings font was selected. It wasn't installed on my system therefore didn't show as such :) I've pushed a new version using a default font which should be available for everyone.


Request new module: terraform-gitops-data-virtualization

Related user story
https://github.ibm.com/gsi-labs/industry-cloud-planning/issues/586
Type of module
gitops
If requesting a terraform module, what is the target cloud platform?
cloudpak
What is the purpose of the module?
Purpose of this module is to provision a Data Virtualization instance on Cloud Pak for Data.
What is the category of the module?
service

/displayName Data Virualization

/displayName Data Virtualization

Repo renamed to https://github.com/cloud-native-toolkit/terraform-gitops-data-virtualization

@spansare invited to repo with write access


Fix #962: Copyright Check should check versus target branch instead of master.

See tests of the functionality in the following PRs:

#2896 (release/1.4-ci)
#2924 (release/1.4 test output comparison)
#2925 (release/2.0-ci)
#2926 (release/2.0 test output comparison)

Fixes #962

This PR replaced by #2933


Remove examples of time metrics not using seconds

Is there a rule for all time based stuff to be reported in seconds?

It's a general recommendation and one we try to implement in all the official repos at least. Unfortunately, there's still some remnants from olden times (like in the Go client library - http_request_duration_microseconds), but those should be fixed over time. The rationale is that things are easier to work with if everything is in base units. That doesn't only go for time, but also for bytes and other units. I don't think we've written that down in any official doc yet though.

It's in both the client library and exporter guidelines.

And will be part of the RFC as SHOULD.
Richard
Sent by mobile; excuse my brevity.

Right, that doesn't cover normal users of direct instrumentation though. I would have expected it here: https://prometheus.io/docs/practices/naming/
Will send a PR...

Here it is: https://github.com/prometheus/docs/pull/574

Great, thanks for the clarification!


cached_property is settable while property isn't

A property without __set__ raises an AttributeError.
Cached property does not raise an AttributeError when being set.
Is that an implementation defect or intentional?
Shouldn't it behave like a read-only property behaves in terms of writeability?

On the one hand, it seems like an inadvertent side-effect of the implementation. cached_property is currently a non-data descriptor and as such it may be overridden by instance dictionaries. If a __set__ method is added, it becomes a data descriptor and data descriptors always override instance dictionaries. Still, it is possible to change the implementation so that it works correctly even as data descriptor like the latest cached_property_with_ttl.
On the other hand, one could argue that being settable is more of a feature than a bug. I think the major characteristic of cached properties is that they don't incur a (potentially expensive) computation once the value of the property is available. Whether the value became available implicitly through an initial get operation or explicitly through a set is not relevant.

I agree with @gsakkis. Anytime there is a faster way to update the cached_property using additional information you want the property to be setable.
Example: Calculating the center of a graph. (graph.center)
Default: averaging the locations of all the points O(n)
Added a new point: use a weighted average of the current center and the new point O(1)
The default case is necessary if you are going to making arbitrary transformations to the graph, but for special changes to the graph like adding a single new point, you want to be able to set the property from outside the center method.

I'm worried that fixing this might break numerous usages of cached-property. What might be a bug by us might be considered a feature by others. Some thoughts:

Should we continue to allow this behavior?
If we deny this behavior, should we also allow the old behavior as well?
If we allow the old behavior as well, how do we toggle the difference in behavior?
If we are to fix/correct this "bug", it would predicate the release of 2.0

This is a feature of the cached-property decorator, not a bug or question.


Input_signature of a tf.function decorator crashes when using multiple GPUs with MirroredStrategy

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): CentOS Linux 7.6.1810
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: /
TensorFlow installed from (source or binary): pip binary
TensorFlow version (use command below): tensorflow-gpu 2.0.0-beta0
Python version: 3.6.8
Bazel version (if compiling from source): /
GCC/Compiler version (if compiling from source): /
CUDA/cuDNN version: 10.0.130 / 7.6.0
GPU model and memory: Tesla P100-SXM2-16GB

Describe the current behavior
Tensorflow crashes when checking the input_signature of a tf.function decorator when using multiple GPUs in a MirroredStrategy. A ValueError is generated cause a PerReplica object cannot be converted to a Tensor (see the log below). Below you can find the minimum code needed to reproduce the error. The code runs just fine when I only utilize one GPU strategy = tf.distribute.MirroredStrategy(devices=["/gpu:0"]). Furthermore, if the optional argument input_signature is discarded (only using @tf.function()) the error disappears too (again using multiple GPUs). Hence, the specific combination of input_signature and multiple GPUs causes the problem (which I need for performance reasons in my work).
Describe the expected behavior
The code below won't generate any errors.
Code to reproduce the issue
import tensorflow as tf
import numpy as np

strategy = tf.distribute.MirroredStrategy(devices=["/gpu:0", "/gpu:1"])

with strategy.scope():
    dataset = tf.data.Dataset.from_tensor_slices(np.ones([100, 12]).astype(np.float32))
    dataset = dataset.batch(4)
    dataset = strategy.experimental_distribute_dataset(dataset)

    def compute(input_data):
        return tf.reduce_sum(input_data, [1])

    @tf.function(input_signature = (tf.TensorSpec([None, 12], tf.float32),))
    def distributed_run(input_data):
        return strategy.experimental_run_v2(compute, args = (input_data,))

    for x in dataset:
        output = distributed_run(x)
        print(output)

Other info / logs

Traceback (most recent call last):
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/eager/function.py", line 1216, in _convert_inputs_to_signature
value, dtype_hint=spec.dtype)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1100, in convert_to_tensor
return convert_to_tensor_v2(value, dtype, preferred_dtype, name)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1158, in convert_to_tensor_v2
as_ref=False)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1237, in internal_convert_to_tensor
ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 305, in _constant_tensor_conversion_function
return constant(v, dtype=dtype, name=name)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 246, in constant
allow_broadcast=True)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 254, in _constant_impl
t = convert_to_eager_tensor(value, ctx, dtype)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 115, in convert_to_eager_tensor
return ops.EagerTensor(value, handle, device, dtype)
ValueError: Attempt to convert a value (PerReplica:{
0 /job:localhost/replica:0/task:0/device:GPU:0: <tf.Tensor: id=107, shape=(2, 12), dtype=float32, numpy=
array([[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.],
[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.]], dtype=float32)>,
1 /job:localhost/replica:0/task:0/device:GPU:1: <tf.Tensor: id=108, shape=(2, 12), dtype=float32, numpy=
array([[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.],
[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.]], dtype=float32)>
}) with an unsupported type (<class 'tensorflow.python.distribute.values.PerReplica'>) to a Tensor.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "issue2.py", line 19, in
output = distributed_run(x)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/eager/def_function.py", line 432, in call
*args, **kwds)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/eager/function.py", line 1169, in canonicalize_function_inputs
self._flat_input_signature)
File "/data/gent/gvo000/gvo00003/vsc41939/GENIUS/miniconda3/envs/tensorflow2/lib/python3.6/site-packages/tensorflow/python/eager/function.py", line 1222, in _convert_inputs_to_signature
(str(inputs), str(input_signature)))
ValueError: When input_signature is provided, all inputs to the Python function must be convertible to tensors.Inputs ((PerReplica:{
0 /job:localhost/replica:0/task:0/device:GPU:0: <tf.Tensor: id=107, shape=(2, 12), dtype=float32, numpy=
array([[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.],
[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.]], dtype=float32)>,
1 /job:localhost/replica:0/task:0/device:GPU:1: <tf.Tensor: id=108, shape=(2, 12), dtype=float32, numpy=
array([[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.],
[1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1., 1.]], dtype=float32)>
},)), input_signature((TensorSpec(shape=(None, 12), dtype=tf.float32, name=None),)).

Thank you for reporting, we are going to look into fixing this issue.
In the meantime, I am wondering how you can get around this issue to get the performance you're seeking. I am assuming that your input data has varying dimensions in various steps, and you don't want to tf.function to retrace everytime that happens. And you're trying to avoid that re-tracing by providing an appropriate input signature.
The 3 possible workarounds could be:

Try the experimental_relax_shapes argument to tf.function https://www.tensorflow.org/versions/r2.0/api_docs/python/tf/function. This may not give you the most optimal but it could work.
Instead of passing the actual inputs as argument to the tf.function, pass something that can be used to get the inputs. For instance, pass a callable that when called will return the data. This callable will never change so the function will not retrace. This is kind of hacky but something we have used sometimes to get good performance. You can also create the iterator on the dataset by iter(dataset) and pass that as argument to the function, and do next() inside the function to get the inputs. That will also get around this issue, I believe.
You could also consider passing the entire dataset into the tf.function and iterate inside it. This will arguably give you the best performance as it will convert the entire thing into a tf.while_loop.

Thanks for the reply and the suggestions. I will experiment with them in the following days.

I had the same problem and am curious if the suggestions (and which one, specifically) worked for you @mcoolsce

@dsgupta, I tried all the options and the second one seems to work fine:

The argument experimental_relax_shapes had no effect at all.

This is the option I am using now. I create my dataset and make an iterable out of it, which is the only argument going into the tf.function. Inside the function, I call next(dataset) to get access to my data. Performance-wise (tested on 1 GPU), it seems that is option is a little bit slower compared to my original code.

I think the third option is theoretically the fastest but it throws some Out of Memory errors a few iterations in the converted tf.while_loop. I just pass my entire dataset into the tf.function wrapper and used a python for loop to iterate over the data. This is very strange as I had no memory issues at all before (where I iterate over the data using a python for loop outside the tf.function).

@mcoolsce Thanks for the response! I faced the same sort of problem with the third approach, but instead of Out of Memory, I was getting Recursion Depth Exceeded if I tried using for input in dataset: I'll try the second one and see how it goes.

The first one doesn't work.
I tried the second option, but it turns out to be another problem "BaseCollectiveExecutor::StartAbort Out of range: End of sequence".
The third option is not suitable for me since I want to dynamically adjust the training strategy with the loss from the train step.
Any other suggestions ?

@Slyne is the issue you encountered with second approach a bug? perhaps you can file a separate issue for that and we can figure out how you can make progress with that?
the only other workaround I can think of is if you want to actually make up the distributed input signature yourself. I can provide the code for that but it requires using private TF APIs.

@Slyne is the issue you encountered with second approach a bug? perhaps you can file a separate issue for that and we can figure out how you can make progress with that?
the only other workaround I can think of is if you want to actually make up the distributed input signature yourself. I can provide the code for that but it requires using private TF APIs.

The second workaround gives an error like this issue https://github.com/tensorflow/tensorflow/issues/22484, unless I stop iterating the dataset before the last step.

@Slyne can you share the code for what you're doing when using the second workaround? likely you need to change your code to catch the out of range error (or i maybe able to suggest a slightly different API to get the next element)

Any info about when will this bug be fixed?

Any info about when this bug will be fixed. For dynamic batch size inputs, this input_signature is essential, otherwise it will lead to tracing, which is very expensive.

This issue has now been fixed. You can use the element_spec property on the dataset or iterator to specify the tf.TypeSpec. For example,
`
For the experimental_distribute_dataset API
dataset = tf.data.Dataset(...)
dist_dataset = strategy.experimental_distributed_dataset(dataset)
Use the element_spec of the distributed dataset
@tf.function(input_signature=[dist_dataset.element_spec])
def train_step(...):
....
Use the element_spec of the distributed iterator
iterator = iter(dist_dataset)
@tf.function(input_signature=[iterator.element_spec])
def train_step(..)
...
For the experimental_distribute_datasets_from_function API
Use the element_spec of the distributed iterator
dataset = tf.data.Dataset(...)
dist_dataset = strategy.experiemental_distribute_datasets_from_function(dataset)
iterator = iter(dist_dataset)
@tf.function(input_signature=[iterator.element_spec])
def train_step(..)
...
`
Please reopen if you run into issues.

@anj-s @alisaaalehi
the provided solution doesn't work for me (on 2.2.0.dev20200207).

can you clarify which function would need to be decorated the inner train_step or the distributed_train_step
my guess is that in my case the input_signature doesn't match as I modify the input in the training step (x = encoder(x)). Is that correct? What would be a suggested better way to handle thins?

        def train_step(x, y):
            with tf.GradientTape() as tape:
                logits = model(x, training=True)
                # Loss value for this batch.
                loss, metrics = loss_fn(logits, targets, encoder)
                loss = loss * (1.0 / global_batch_size)
                # Get gradients of weights wrt the loss.
                gradients = tape.gradient(loss, mapper.trainable_weights)
                # Update the weights of our model
                optimizer.apply_gradients(zip(gradients, mapper.trainable_weights))
                return loss, metrics

        @tf.function(input_signature=[train_iter.element_spec])
        def distributed_train_step(x, y):
            per_example_losses, _ = mirrored_strategy.experimental_run_v2(
                train_step, args=(x, y)
            )
            return mirrored_strategy.reduce(
                tf.distribute.ReduceOp.SUM,
                per_example_losses,
                axis=None
            )

        def distributed_training(steps):
            total_loss = 0.0
            num_train_batches = 0.0
            for _ in range(steps):
                x, y = next(train_iter)
                x = encoder(x)  #  would this be a problem?
                total_loss += distributed_train_step(mix, targets)
                ckpt.step.assign_add(1)
                num_train_batches += 1

            return total_loss, num_train_batches

This is still not working even in TF-2.2.0 and 2.3 nightlly gpu versions. Any thoughts on this?

@s4sarath please provide code to repro your issue (either here or in a new bug).

Hi @guptapriya . Thanks for the quick response.  I have tested this both on TF 2.2.0 GPU and TF 2.3 nightly build also . On colab.
a.) Using MirroredStrategy experimental distribute ( TF 2.2.0 )
ds = strategy.experimental_distribute_dataset(train_dataset)
def train_no_tracing(ds):
  @tf.function(input_signature=[ds.element_spec])
  def step_fn(inputs):
    # train the model with inputs
    return inputs
  for index,batch in enumerate(ds):
    replica_results = strategy.run(step_fn, args=(batch,))
    print(index)
    if index == 11:
      break

train_no_tracing(ds)

TypeError                                 Traceback (most recent call last)
 in ()
----> 1 train_no_tracing(ds)
12 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/func_graph.py in wrapper(*args, **kwargs)
966           except Exception as e:  # pylint:disable=broad-except
967             if hasattr(e, "ag_error_metadata"):
--> 968               raise e.ag_error_metadata.to_exception(e)
969             else:
970               raise
TypeError: in user code:
TypeError: tf___call_for_each_replica() missing 1 required positional argument: 'kwargs'

b.) Same code in  TF nightly build '2.3.0-dev20200605'
Now error is somewhat similar not exact

TypeError                                 Traceback (most recent call last)
 in ()
12       break
13
---> 14 train_no_tracing(ds)
13 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/func_graph.py in wrapper(*args, **kwargs)
966           except Exception as e:  # pylint:disable=broad-except
967             if hasattr(e, "ag_error_metadata"):
--> 968               raise e.ag_error_metadata.to_exception(e)
969             else:
970               raise
TypeError: in user code:
/usr/local/lib/python3.6/dist-packages/tensorflow/python/distribute/mirrored_run.py:96 call_for_each_replica  *
    return _call_for_each_replica(strategy, fn, args, kwargs)

TypeError: tf__step_fn() takes 1 positional argument but 2 were given

c.) Using experimental_distribute_from_dataset_function
def get_dataset_fn():
  """Gets a closure to create a dataset.."""

  def _dataset_fn(input_context=None):
    """Returns tf.data.Dataset for distributed BERT pretraining."""
    batch_size = input_context.get_per_replica_batch_size(
                    BATCH_SIZE)
    print("batch_size", batch_size, input_context)
    print('---------------------------------------')
    d = train_dataset
    return d

  return _dataset_fn

input_fn = get_dataset_fn()
ds = iter(strategy.experimental_distribute_datasets_from_function(input_fn))

# Lets run a simple iteration

def train_with_tracing(ds):
  @tf.function(input_signature=None)
  def step_fn(inputs):
    # train the model with inputs
    return inputs
  # epochs
  for index in range(1000):
    replica_results = strategy.run(step_fn, args=(next(ds),))
    print(index)
    if index == 11:
      break

train_no_tracing(ds)

TypeError: tf___call_for_each_replica() missing 1 required positional argument: 'kwargs'

Here is the gist for TF 2.2.0
https://colab.research.google.com/gist/s4sarath/899d93bd5381efd34dffe9f89c2688a6/dataset_gpu.ipynb
Here is the gist for TF 2.3 nightly
https://colab.research.google.com/gist/s4sarath/f42fece3e4f217ee3c0b9a5873223160/dataset_gpu_nightly.ipynb

To give some idea about dataset, it is having same batch_size, but different inupt length in each batch. ( dynamic input , to avoid unnecessary padding ) . Thats what tracing is precisely using for I guess .

thanks @s4sarath. @anj-s could you take a look at the attached colabs? This looks like a bug to me - it could likely be due to how we handle fn passed to run that are annotated with tf.functions.
@s4sarath one thing you could try right now is to put the call to run inside a tf.function and add the input signature to that. See this unit test here:
https://github.com/tensorflow/tensorflow/blob/a00daa2f37954ed7d1fae09dfad81b3168b76715/tensorflow/python/distribute/input_lib_type_spec_test.py#L184


rio: 0.0.18 -> 0.0.19

Description of changes
Updating the rio terminal to latest released version.
Changelogs

https://github.com/raphamorim/rio/releases/tag/v0.0.19

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Done in #256123.

Wonder why the PR order was reversed and closed.

What do you mean?


Create a metadata mutation builder

The function addNewTablet() at MasterMetadataUtil line 67 contains a lot of code to construct a metadata table mutation.   It would be nice to replace this code with something like the following.
TabletMutation.Builder builder = TabletMutation.builder().for(extent)
  .directory(path)
  .time(time);

if (lastFlushID > 0)
  builder.flushId(lastFlushID);

if (lastCompactID > 0)
  builder.compactId(lastCompactID);

builder.dataFiles(datafileSizes);
builder.bulkLoads(bulkLoadedFiles);

Mutation m = builder.build();

Doing this would centralize the code for serializing tablet metadata for write.  It should be designed by using similar methods names to TabletMetadata which is an abstraction for deserializing and using  tablet metadata.  Not sure, but it may be useful if the same builder could build a mutation or TabletMetadata object.

A mutation builder may not be the best abstraction since it would not help with root tablet metadata updates.  One nice property of the mutation builder is that it would make updating many tablets using a batchwriter efficient.

https://issues.apache.org/jira/browse/ACCUMULO-2272

To support easily writing to Zookeeper, root table, or the metadata table I have been experimenting with an interface like the following.   I am thinking ServerContext would provide an instance of this interface.
/**
 * An abstraction layer for mutating Accumulo's persistent metadata.  This metadata may be stored
 * in Zookeeper of Accumulo's own metadata table.
 */
public interface MetadataMutator {
  /**
   * Select what we are going to mutate.  This may return a mutator for Zookeeper or the metadata
   * tables.
   */
  public interface Selector {
    TabletMutator tablet(TableId tableId, Text endRow);
    TabletMutator tablet(KeyExtent extent);
    GcMutator deletesFor(TableId tableId);
  }

  /**
   * Interface for changing a tablets persistent data.
   */
  public interface TabletMutator {
    public TabletMutator setPrevEndRow(Text per);
    public TabletMutator addFile(String path, DataFileValue dfv);
    public TabletMutator addFiles(Map<String, DataFileValue> files);
    public TabletMutator removeFile(String path);
    public TabletMutator removeFiles(Collection<String> paths);

    void mutate();
  }

  /**
   * Interface for adding and removing file delete markers used for garbage collection.
   */
  public interface GcMutator {
    public void insert(String path);
    public void insert(Collection<String> paths);
    public void remove(String path);
    public void remove(Collection<String> paths);
  }

  Selector mutating();
}

Using this interface I rewrote replaceDatafiles() that is used to update a tablets files after a major compaction.
  public static void replaceDatafiles(ServerContext context, KeyExtent extent,
      Set<FileRef> datafilesToDelete, Set<FileRef> scanFiles, FileRef path, Long compactionId,
      DataFileValue size, String address, TServerInstance lastLocation, ZooLock zooLock,
      boolean insertDeleteFlags) {

    MetadataMutator meta = context.getMetadataMutator();

    if (insertDeleteFlags) {
      meta.mutating().deletesFor(extent.getTableId()).insert(datafilesToDelete);
    }

    TabletMutator tablet = meta.mutating().tablet(extent);

    tablet.removeFiles(datafilesToDelete);
    tablet.addScans(scanFiles);
    if (size.getNumEntries() > 0)
      tablet.addFile(path, size);

    if (compactionId != null)
      tablet.updateCompactionId(compactionId);

    TServerInstance self = getTServerInstance(address, zooLock);

    tablet.insertLastLocation(self);

    if (lastLocation != null && !lastLocation.equals(self))
      tablet.removeLastLocation(lastLocation);

    tablet.updateLock(zooLock);

    tablet.mutate();

  }

I am not sure about the actual names, but I like this design because when using it there is no need to worry about zookeeper or mutations.


Clarify identity platform CNAME behaviour

Added information to help users understand and resolve obscure O365 license activation errors.

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks

@JohanFreelancer9

@kelleyvice-msft Please merge this PR. Thanks


Use tox to manage tests

As title.

Coverage: 34.985%. Remained the same when pulling 6bdbefa46467f00593f7d5007be7252e7ba37cbd on tox into f13d85491e920c07d996c3220269f4c9d20feef2 on main.


Force "None" source code provider on CI.

This avoids UE 5.4 considering our non-read-only source files to be part of the working set and leaving them out of the unity build.
Fixes #1410

This seems to have worked well. The 5.4 binaries are a similar size to earlier versions now.