GATE-2386: Adds support for missing team rules settings

This PR adds support for creating rules with session management
settings (check_session), adding HTTP headers (add_headers), and other
missing browser isolation options.
This PR depends on https://github.com/cloudflare/cloudflare-go/pull/786

acceptance tests look good!
TF_ACC=1 go test $(go list ./...) -v -run "^TestAccCloudflareTeamsRuleBasic" -count 1 -parallel 1 -timeout 120m -parallel 1
?   	github.com/cloudflare/terraform-provider-cloudflare	[no test files]
=== RUN   TestAccCloudflareTeamsRuleBasic
--- PASS: TestAccCloudflareTeamsRuleBasic (11.09s)
PASS
ok  	github.com/cloudflare/terraform-provider-cloudflare/cloudflare	11.401s
?   	github.com/cloudflare/terraform-provider-cloudflare/tools/cmd/changelog-check	[no test files]
?   	github.com/cloudflare/terraform-provider-cloudflare/version	[no test files]

once we update the website documentation to include the new fields, we can merge this.

acceptance tests are now passing
TF_ACC=1 go test $(go list ./...) -v -run "^TestAccCloudflareTeamsRuleBasic" -count 1 -parallel 1 -timeout 120m -parallel 1
?   	github.com/cloudflare/terraform-provider-cloudflare	[no test files]
=== RUN   TestAccCloudflareTeamsRuleBasic
--- PASS: TestAccCloudflareTeamsRuleBasic (13.53s)
PASS
ok  	github.com/cloudflare/terraform-provider-cloudflare/cloudflare	14.127s
?   	github.com/cloudflare/terraform-provider-cloudflare/tools/cmd/changelog-check	[no test files]
?   	github.com/cloudflare/terraform-provider-cloudflare/version	[no test files]


Move away from argparse.Namespace

The core Problem class still using argparse.Namespace for historic reasons. This needs to be moved as HParams class is capable of providing the same interface.

Fixed.


Ctrl+Esc to stop doesn't stop on Windows

Testing #217202

Enable text buttons
ctrl+i
Highlight some code and ask "What does this do?"
Streaming starts, and the "ctrl+esc to stop" button shows.
ctrl+esc.
It actually opens the Windows start menu and streaming continues. It seems like this is a default Windows shortcut.

They have a whole keyboard button for that, why are they taking ctrl+esc too... 😠

Going with alt+backspace

Works great!


[doc]Fix sphinx errors and warnings

Sphinx was unable to create link to plot3d.items without the full path (confusion with plot.items)
@t20100 : I'm not sure about https://github.com/silx-kit/silx/commit/9c82c19e929930e645161462804a79207e0c7b89 . Maybe it would be better to import/expose CurveStyle also in silx/gui/plot/items/__init__.py instead of providing the correct path in the incorrect doc page.

@PiRK yes it would be better to provide it in the __init__.py


Install MySQL server and MySQLWorkbench on the VM

Need this for one merged tooth_history table later on.

@wdduncan Hi Bill, I have installed MySQL server on the vm. I just attached couple of screenshots to show you the connection to MySQL with DBVisualizer and the MySQL service under Windows services utility.

data dir is E:\development\mysql\data (defined in :\Program Files\MySQL\MySQL Server 5.7\my.cnf)
database "edr" was created
DB user "edruser" was created and I can give the password to whoever will need it later on in person. I have granted all permissions on "edr" to "edruser".
installed MySQL service as Windows service. So it should restart with the VM or manually start with Windows services utility
MySQLWorkbench is NOT installed due to VM lack of Microsoft Visual C++ packs.

@chen-regen
Thanks Chen! Can you please see if you can upload files using DBVis? The workbench has a nice feature that allows you to import a file into a table. This can be used to created tables or append new records. I do know not if you can do this with DBVis.

Will do Bill. I'll see if DBVis has any similar functionality. I think mysql has its own data loading util by loading csv file into a table. So probably the worst case is to use that instead.


Broken links on homepage

The headlines "Latest activity" and "Latest added" are links. However the target pages don't exist.

Thanks.


repetition problem of (begin simulation ..... and simulation) in the stats.txt file

please, help me, when i have run the benchmark parsec i have some repetition of (begin simulation ...... end simulation) in the stats.txt file with some informations defferent and i'm looking for the execution time .

Hi HADOUDA,
In order to make it more likely that you will get your problem solved, please provide more details:

what is your gem5 version
what command did you run
what was the relevant stdout output and terminal output
what did you expect to see instead

hi,
-I uploaded the latest version of gem5 in gihub, I executed the following command (./build/X86/gem5.opt configs/example/fs.py --kernel=/media/ali/ali/gem5/full_system/binaries/x86_64-vmlinux-<IP_ADDRESS>.smp)with disk image x86root-parsec.img.
i used a .rcs script to run a parsec application eg blackscholes, when i saw the stats file .txt i found several parts of (begin simulation ............ ..and simulation) with deferent information for example the execution time; because I think that in reality I found  one part of (begin simulation .... end simulation)
to take the correct execution time .
thank you;

thanks

thanks


Support setting credentials in JSONAPISource

So that credentials: 'same-origin' and similar can be set (see here for more info).
This is needed in case where cookie must be sent back to the server.

I used this as a workaround (probably there are cleaner ways to do it):
remoteSource.fetch_orig = remoteSource.fetch;
remoteSource.fetch = function(url, settings = {}) {
  settings.credentials = 'same-origin';
  return this.fetch_orig(url, settings);
};

As described in #518, credentials can now be defined as part of defaultFetchSettings for the source, or as request-specific options.


import failed

after installing it, it gives me this error:
Traceback (most recent call last):
File "C:\AI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1931, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 940, in exec_module
File "", line 241, in call_with_frames_removed
File "C:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-IF_AI_tools_init.py", line 9, in
from .IFChatPromptNode import IFChatPrompt
File "C:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-IF_AI_tools\IFChatPromptNode.py", line 14, in
from .send_request import send_request
File "C:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-IF_AI_tools\send_request.py", line 5, in
from .groq_api import send_groq_request
File "C:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-IF_AI_tools\groq_api.py", line 1, in
from groq import Groq
ModuleNotFoundError: No module named 'groq'

I forgot I was using Groq client instead of REST API please activate comfyui environment and pip install groq or if you have the manager click pip install and type groq

I forgot I was using Groq client instead of REST API please activate comfyui environment and pip install groq or if you have the manager click pip install and type groq

Okay, perfect... I'm not really an expert... thanks.

ok now it's loaded thanks!


Code change required, need to be updated to accessToken from result.AccessToken

The code block in the Option 3: Call a downstream web API without the helper class should be updated to accessToken from result.AccessToken, as there is only one parameter, string accessToken in the function CallTodoListService.
Current:
private async Task CallTodoListService(string accessToken)
{
  // After the token has been returned by Microsoft.Identity.Web, add it to the HTTP authorization header before making the call to access the todolist service.
  _httpClient.DefaultRequestHeaders.Authorization = new AuthenticationHeaderValue("Bearer", result.AccessToken);

  // Call the todolist service.
  HttpResponseMessage response = await _httpClient.GetAsync(TodoListBaseAddress + "/api/todolist");
  // ...
}

Prposed:
private async Task CallTodoListService(string accessToken)
{
  // After the token has been returned by Microsoft.Identity.Web, add it to the HTTP authorization header before making the call to access the todolist service.
  _httpClient.DefaultRequestHeaders.Authorization = new AuthenticationHeaderValue("Bearer", accessToken);

  // Call the todolist service.
  HttpResponseMessage response = await _httpClient.GetAsync(TodoListBaseAddress + "/api/todolist");
  // ...
}

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b124de3b-0981-7064-5ff6-43fd67eeb36d
Version Independent ID: 0c36165d-80b7-56ba-8208-3e13b9f754e6
Content: Web API that calls web APIs - Microsoft identity platform
Content Source: articles/active-directory/develop/scenario-web-api-call-api-call-api.md
Service: active-directory
Sub-service: develop
GitHub Login: @jmprieur
Microsoft Alias: jmprieur

@SibeeshVenu
Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.

This is fixed (see PR)
#please-close


[Feature] Product View Permission

Summary:
A new type of permission for enabling users to only view the contents, they cannot add or modify the contents of the server.
Progress:

[x] Implementation of feature
[x] Tests
[x] Documentation

Fixes #3308

@csordasmarton This is the current version of the pull request. In the web-view, the Product_VIEW name does not appear although the checkbox does appear. Is it something we need to fix in the front-end code or from our side? In the terminal the permission change message is displayed, but when I try to login, it says you don't have access. Are you facing the same issue as well?

@csordasmarton there are a lot of conflicts with the package.json and tar.gz files. How do we resolve those, especially the tar.gz files?

@csordasmarton I made the changes told by you in https://github.com/Ericsson/codechecker/pull/3332#discussion_r651960070. But when I try to see the reports. I am not sure as to what is the error in this, maybe it is getting broken while we update it to the new version of 6.41. I did not push it to the pull request to not disturb the chain. I am attaching the error and the github branch containing the change. How do we surpass this?
Error
Traceback (most recent call last):
  File "/home/jay/codechecker/build/CodeChecker/lib/python3/codechecker_server/api/report_server.py", line 127, in wrapper
    res = func(*args, **kwargs)
  File "/home/jay/codechecker/build/CodeChecker/lib/python3/codechecker_server/profiler.py", line 74, in wrapper
    return release_wrapper(*args, **kwargs)
  File "/home/jay/codechecker/build/CodeChecker/lib/python3/codechecker_server/profiler.py", line 66, in release_wrapper
    res = function(*args, **kwargs)
  File "/home/jay/codechecker/build/CodeChecker/lib/python3/codechecker_server/api/report_server.py", line 1626, in getReportDetails
    with DBSession(self.__Session) as session:
AttributeError: 'ThriftRequestHandler' object has no attribute '_ThriftRequestHandler__Session'
[WARNING 2021-06-16 00:39] - getReportDetails:
'ThriftRequestHandler' object has no attribute '_ThriftRequestHandler__Session'

Github branch
https://github.com/jay24rajput/codechecker/tree/login_guest_test

@csordasmarton Any idea why the two tests aren't executing?

@jay24rajput from the logs I don't know. I restarted the test cases, maybe that will solve the problem. If no, we need to run the failed test case manually and debug the problem.

Just a quick update: we already rolled out this feature on our CodeChecker instance, https://elisa-builder-00.iol.unh.edu:8001/, and from my five-minute try-out testing with the guest access, it works just as I would have expected it.


(IMPORT FAILED) ComfyUI-MuseTalk

I tried everything but when i install the ComfyUI-MuseTalk extension on Comfyui, it shows this error. I've installed all the requeriments already, can somebody help me?

Same here. We need some helpppppp.

seems it missed some models, any error msg on comfyui log?

yea, import failed,  no errors in log!

Here is the errror
File "D:\ComfyUI\custom_nodes\ComfyUI-MuseTalk_init_.py", line 1, in
from .nodes import NODE_CLASS_MAPPINGS
File "D:\ComfyUI\custom_nodes\ComfyUI-MuseTalk\nodes.py", line 26, in
from musetalk.utils.preprocessing import get_landmark_and_bbox,read_imgs,coord_placeholder
File "D:\ComfyUI/custom_nodes/ComfyUI-MuseTalk\musetalk\utils\preprocessing.py", line 10, in
from mmpose.apis import inference_topdown, init_model

Rename the file: ComfyUI/models/diffusers/TMElyralab/MuseTalk/musetalk/musetalk_musetalk.json
The file must have a name: musetalk.json

重命名文件：ComfyUI/models/diffusers/TMElyralab/MuseTalk/musetalk/musetalk_musetalk.json 文件必须具有名称：musetalk.json

THx,Ignored the name issue

For me that file is not even present there!

Hello, for the directory structure, under ubuntu, would it still be ComfyUI/models/diffusers/TMElyralab/MuseTalk ? I have it set exactly this way with all the models installed within the subdirectories but am still getting an error where the node isn't found.


Include Assistants API

Add the Assistants API (beta) https://platform.openai.com/docs/assistants/overview
@didalgolab Let me know if you would like to implement this API. If it is not possible, I could work on this.

@didalgolab, Thanks for working on this. Please, could you use this ticket for your changes?
Currently, the master branch has been updated with my changes for the other endpoints, and today I am going to update cleverclient (removing code related to immutable request objects) and immediately I will update simple-openai to use the latest cleverclient and to use the Lombok With annotation (simplifying our OpenAI.java interface and removing BodyPart usages).
I communicate you all these things to be in sync with you. Please, let me know if you have any concerns.
Do you think that it will be a good thing to create a Slack channel to have better communication? Or do you prefer to keep our communication by Github as currently? Or do you have another proposal?

I've added a PR https://github.com/sashirestela/simple-openai/pull/19 with my changes. Currently I'm waiting for you to integrate changes for https://github.com/sashirestela/cleverclient/pull/20 in the simple-openai project, because currently it doesn't compile after I have upgraded clever client to the latest version. But I'm sending the PR anyway, so that you can have a look already, and let me know issues you may have.
Regarding the proposal thank you, but I'm currently pausing any new development against OpenAI API - just wanted to finish the assistants part which I've already 95% complete.

@didalgolab I want to express my gratitude for all your help with this open source project. I really appreciate your amazing contributions.
Before you leave, I would like to know what are the pending parts in the Assistants API?
Finally, if you don't mind, could you give me some feedback on the project or my performance as the project owner?

@sashirestela Thank you for your kind words.
The Assistants API should be 100% complete, unless I've missed something - in which case let me know and I will try work that out. What I meant previously is that I had 95% ready, and managed to complete the remaining 5% on a day when I've pushed the PR.
However, I expect a lot of changes in the future to that API from OpenAI, because in current form the costs of using Assistants API are uncontrollable and unpredictable. In my opinion, it is barely usable right now.
Regarding the feedback, I'm not sure if I'm the right person to give one. Ultimately it all depends if the community can find this library useful. Anyway, here are my loose thoughts (but don't take them as a criticism in any way):

the library lacks build-in retry with exponential backoff (the official Python library has this),
error handling could be better, preferably with custom unchecked exception carrying the exact JSON error response returned by the OpenAI API, so the user can catch this exception, inspect its details, and act accordingly; maybe even separate dedicated exceptions for rate limit errors, and token limit exceeded errors;
for me it's debatable if FunctionExecutor should just throw SimpleUncheckedException when something goes wrong as it is now, or instead pass the error back to the LLM, to give the model chance to correct itself,
the Clever Client part is nice, but it looks a bit like reinventing a wheel (I get the impression that you were inspired by Feign, is that right?). Spring 6 introduces declarative HTTP services: https://www.baeldung.com/spring-6-http-interface, maybe those could serve as a good replacement for Clever Client? You would effectively have less code to maintain, and also Spring's WebFlux HTTP client is quite good.
support for Azure OpenAI API could be useful for some people,
also, I can see few ways to reduce number of Jackson annotations in your code, for example:

correcting property name to use underscore with e.g. @JsonProperty("response_format") can be replaced with just configuring PropertyNamingStrategies.SNAKE_CASE on the ObjectMapper level;
@JsonInclude(Include.NON_NULL) can be also configured on the ObjectMapper level;

I'm not quite sure that date-time response properties should be mapped to Long fields on the Java side (for instance the property CharResponse -> private Long created;), and actually, as you probably have already seen in my Assistants API code, I have used ZonedDateTime type with custom Jackson deserializer for date-time properties.

Overall, although I see areas in which the project is lacking, I find it also useful... Thank you for your service! 🫡

@didalgolab Thank you very much for your great observations, I am going to take them into account, for sure!


feat: add argument channel for version-controller

This PR close #102 with the addition of a filter argument for channel for get builds based in version, for avoid a breaking this PR add the argument like a optional in request (aka filter for "all") this also make the possible errors make more detailed about the valid channels for avoid get empty builds for the bad typing.

A little bump for know if this is being consider


Review Usages of actionGet API Call

Review Usages of actionGet API Call
Describe the bug
Review usages of actionGet API calls so that this API if being called in a single threaded pool should use timeouts or should be called asynchronously.
PRs in alerting (https://github.com/opensearch-project/alerting/pull/130) and index management (https://github.com/opensearch-project/index-management/pull/100) where we have replaced the usages of the actionGet API calls which are blocking in nature and block the execution of the program with the callback listeners for the API call response. Using this API with time outs is okay but the execution should be made asynchronous.
Sample Usage in Dashboards:
https://github.com/opensearch-project/anomaly-detection/blob/cfebf07f637c05753e32a1648d05db98e1120e0f/src/main/java/org/opensearch/ad/util/ClientUtil.java#L184
We should review all such usages.

No actionGet being used in AD code.


Add support for shutdown script run

Fixes https://github.com/casper-network/casper-node/issues/3040
This PR adds support for the ShouldExitLauncher exit code. After receiving this exit code, the launcher will run a script at /etc/casper/casper_shutdown_script and then exit with its exit code if the script exists, otherwise it will just exit with exit code 0.
This PR also adds a test for the shutdown script run triggered by the new exit code introduced earlier. Unfortunately, it's very hard to do a negative test here because of the way the code is structured right now and because of process:exit(), which would take down the whole test process if ran.

bors r+


Option to print error stack

hi! Say my code has a syntax error:
/**
 * Documenting some broken code
 */
function badJavascriptSyntax () {
  const a = { one: 1, two: 2 }
  const b = { ..a } // should be three fullstops
}

Running jsdoc highlights the error but not the line number where i can find the issue..
$ jsdoc broken-javascript.js
ERROR: Unable to parse /Users/lloydb/broken-javascript.js: Unexpected token .

Is there a way to print the full parse error stack?

+1
As a workaround, you can use a quick little node.js script I made. It uses espree which I believe is the linter jsdoc uses.
espree-check.txt
To install espree:
npm i espree --save
Then call it like:
node.exe espree-check.txt --file some.js
It should print the same error jsdoc gives, but at the bottom of the (long) trace you will see "lineNumber: x, column: y".
Saved me a lot of time.

On master, JSDoc now prints the line number and column when there's a syntax error, which should make it easier to track down the problem. Printing the stack trace wouldn't be helpful in most cases.

true, the fix has landed on master.. Once he's finished the new release (3.5.0) i'll pull it into jsdoc2md.


error when trying to modify code to train  on tpu's.

I am training model on colab. Already raised issue in googlecolab/colabtools .But, no answers.
I am working on kaggle dataset [https://www.kaggle.com/c/severstal-steel-defect-detection/data]. Its a segmentation task. In which label(masks) are not given directly, they gave encoded pixels. we need to transform them back to image. So, Its a multilabel segmentation. for each class of the image from the encoded pixels I converted them to image and saved in four files(four classes) also has some images in which there are no labels for them I made simply np.zeros(). In the custom data generator my aim is to for every image get those mask images stack them and finally get mask as (x,y,4).
below is the code of the custom data generator::
class DataGenerator(tf.keras.utils.Sequence):
    def __init__(self,batch_size,dataframe,x_col,y_col,number_classes,dimensions=[256,1600,3],shuffle=True):
        self.batch=batch_size
        self.df=dataframe
        self.x=x_col
        self.y=y_col
        self.classes=number_classes
        self.dim=dimensions
        self.indexes=self.df.index.tolist()
        self.shuffle=shuffle
        self.index_of_indexes=np.arange(len(self.indexes))
        self.on_epoch_end()
        self.n=0
        self.max=self.__len__()
    def __len__(self):
        return int(np.floor(len(self.indexes)/self.batch))
    def on_epoch_end(self):
        if self.shuffle==True:
            np.random.shuffle(self.index_of_indexes)
    def __next__(self):
      if self.n>=self.max:
        self.n=0
      result = self.__getitem__(self.n)
      self.n += 1
      return result
    def __getitem__(self,index):
        temp_index_of_indexes=self.index_of_indexes[index*self.batch:(index+1)*self.batch]
        temp_indexes=[self.indexes[i] for i in temp_index_of_indexes]
        X=np.empty((self.batch,self.dim[0],self.dim[1],self.dim[2]))
        Y=np.empty((self.batch,self.dim[0],self.dim[1],self.classes))
        for i,id_ in enumerate(temp_indexes):
            image_name=str(self.df.loc[id_,self.x])
            classes_list=np.array(self.df.loc[id_,self.y])
            shape=[self.dim[0],self.dim[1]]
            X[i,],Y[i,]=self.get_data(image_name,classes_list,shape)
        return X,Y
    def get_data(self,image_name,classes_list,shape):
        for i,c in enumerate(classes_list):
            if i==0 and c==1:
                file=image_name.split('.')[0]+'.npy'
                path='/content/severstal-steel-defect-detection/temp1/'+file
                channel1=np.load(path)
                channel1=channel1/255.0
            elif i==0 and c==0:
                channel1=np.zeros((shape[0],shape[1]))
            elif i==1 and c==1:
                file=image_name.split('.')[0]+'.npy'
                path='/content/severstal-steel-defect-detection/temp2/'+file
                channel2=np.load(path)
                channel2=channel2/255.0
            elif i==1 and c==0:
                channel2=np.zeros((shape[0],shape[1]))
            elif i==2 and c==1:
                file=image_name.split('.')[0]+'.npy'
                path='/content/severstal-steel-defect-detection/temp3/'+file
                channel3=np.load(path)
                channel3=channel3/255.0
            elif i==2 and c==0:
                channel3=np.zeros((shape[0],shape[1]))
            elif i==3 and c==1:
                file=image_name.split('.')[0]+'.npy'
                path='/content/severstal-steel-defect-detection/temp4/'+file
                channel4=np.load(path)
                channel4=channel4/255.0
            elif i==3 and c==0:
                channel4=np.zeros((shape[0],shape[1]))
        path='/content/severstal-steel-defect-detection/train_images/'+image_name
        image=load_img(path,target_size=(shape[0],shape[1],3))
        image=img_to_array(image)
        image=image/255.0
        mask=np.stack([channel1,channel2,channel3,channel4],axis=-1)
        image=tf.cast(image,dtype=tf.float32)
        mask=tf.cast(mask,dtype=tf.float32)
        return image,mask

I am using unet as my model. Also, when I am using gpu its working fine. But, taking a lot of time. So, I wanted to use TPU's.
So, the datagenerator which I created is working is fine. I also made my model as a function and my loss function amd metric I mentioned them in my tpu_strategy.scope() only. I am not understanding whats my error::
batch1=4 * tpu_strategy.num_replicas_in_sync
batch2=2 * tpu_strategy.num_replicas_in_sync

with tpu_strategy.scope():
  training_model=custom_model()
  def soft_dice_loss(y_true,pred):
    y_true=K.flatten(y_true)
    pred=K.flatten(pred)
    intersec=(2*K.sum(y_true*pred))+1e-9
    deno=K.sum(y_true**2)+K.sum(pred**2)+1e-9
    return 1-K.mean(intersec/deno)
  def soft_dice_coeff(y_true,pred):
    y_true=K.flatten(y_true)
    pred=K.flatten(pred)
    intersec=(2*K.sum(y_true*pred))+1e-9
    deno=K.sum(K.abs(y_true))+K.sum(K.abs(pred))+1e-9
    return K.mean(intersec/deno)
  training_model.compile(
      optimizer='Adam',
      loss=soft_dice_loss,
      metrics=[soft_dice_coeff])

Epoch 1/100
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/data/ops/multi_device_iterator_ops.py:601: get_next_as_optional (from tensorflow.python.data.ops.iterator_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Iterator.get_next_as_optional()` instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/data/ops/multi_device_iterator_ops.py:601: get_next_as_optional (from tensorflow.python.data.ops.iterator_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Iterator.get_next_as_optional()` instead.
---------------------------------------------------------------------------
UnavailableError                          Traceback (most recent call last)
<ipython-input-57-1b0974d37f1f> in <module>()
     13                               dimensions=[256, 1600, 3],
     14                               shuffle=True)
---> 15 training_model.fit(train_generator,epochs=100,steps_per_epoch=train_image_csv.shape[0]//4,validation_data=valid_generator,validation_steps=valid_image_csv.shape[0]//2)

14 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/engine/training.py in _method_wrapper(self, *args, **kwargs)
    106   def _method_wrapper(self, *args, **kwargs):
    107     if not self._in_multi_worker_mode():  # pylint: disable=protected-access
--> 108       return method(self, *args, **kwargs)
    109
    110     # Running inside `run_distribute_coordinator` already.

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/engine/training.py in fit(self, x, y, batch_size, epochs, verbose, callbacks, validation_split, validation_data, shuffle, class_weight, sample_weight, initial_epoch, steps_per_epoch, validation_steps, validation_batch_size, validation_freq, max_queue_size, workers, use_multiprocessing)
   1101               logs = tmp_logs  # No error, now safe to assign to logs.
   1102               end_step = step + data_handler.step_increment
-> 1103               callbacks.on_train_batch_end(end_step, logs)
   1104         epoch_logs = copy.copy(logs)
   1105

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in on_train_batch_end(self, batch, logs)
    438     """
    439     if self._should_call_train_batch_hooks:
--> 440       self._call_batch_hook(ModeKeys.TRAIN, 'end', batch, logs=logs)
    441
    442   def on_test_batch_begin(self, batch, logs=None):

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _call_batch_hook(self, mode, hook, batch, logs)
    287       self._call_batch_begin_hook(mode, batch, logs)
    288     elif hook == 'end':
--> 289       self._call_batch_end_hook(mode, batch, logs)
    290     else:
    291       raise ValueError('Unrecognized hook: {}'.format(hook))

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _call_batch_end_hook(self, mode, batch, logs)
    307       batch_time = time.time() - self._batch_start_time
    308
--> 309     self._call_batch_hook_helper(hook_name, batch, logs)
    310
    311     if self._check_timing:

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _call_batch_hook_helper(self, hook_name, batch, logs)
    340       hook = getattr(callback, hook_name)
    341       if getattr(callback, '_supports_tf_logs', False):
--> 342         hook(batch, logs)
    343       else:
    344         if numpy_logs is None:  # Only convert once.

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in on_train_batch_end(self, batch, logs)
    959
    960   def on_train_batch_end(self, batch, logs=None):
--> 961     self._batch_update_progbar(batch, logs)
    962
    963   def on_test_batch_end(self, batch, logs=None):

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/callbacks.py in _batch_update_progbar(self, batch, logs)
   1014     if self.verbose == 1:
   1015       # Only block async when verbose = 1.
-> 1016       logs = tf_utils.to_numpy_or_python_type(logs)
   1017       self.progbar.update(self.seen, list(logs.items()), finalize=False)
   1018

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/utils/tf_utils.py in to_numpy_or_python_type(tensors)
    535     return t  # Don't turn ragged or sparse tensors to NumPy.
    536
--> 537   return nest.map_structure(_to_single_numpy_or_python_type, tensors)
    538
    539

/usr/local/lib/python3.6/dist-packages/tensorflow/python/util/nest.py in map_structure(func, *structure, **kwargs)
    633
    634   return pack_sequence_as(
--> 635       structure[0], [func(*x) for x in entries],
    636       expand_composites=expand_composites)
    637

/usr/local/lib/python3.6/dist-packages/tensorflow/python/util/nest.py in <listcomp>(.0)
    633
    634   return pack_sequence_as(
--> 635       structure[0], [func(*x) for x in entries],
    636       expand_composites=expand_composites)
    637

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/utils/tf_utils.py in _to_single_numpy_or_python_type(t)
    531   def _to_single_numpy_or_python_type(t):
    532     if isinstance(t, ops.Tensor):
--> 533       x = t.numpy()
    534       return x.item() if np.ndim(x) == 0 else x
    535     return t  # Don't turn ragged or sparse tensors to NumPy.

/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/ops.py in numpy(self)
   1061     """
   1062     # TODO(slebedev): Consider avoiding a copy for non-CPU or remote tensors.
-> 1063     maybe_arr = self._numpy()  # pylint: disable=protected-access
   1064     return maybe_arr.copy() if isinstance(maybe_arr, np.ndarray) else maybe_arr
   1065

/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/ops.py in _numpy(self)
   1029       return self._numpy_internal()
   1030     except core._NotOkStatusException as e:  # pylint: disable=protected-access
-> 1031       six.raise_from(core._status_to_exception(e.code, e.message), None)  # pylint: disable=protected-access
   1032
   1033   @property

/usr/local/lib/python3.6/dist-packages/six.py in raise_from(value, from_value)

UnavailableError: 9 root error(s) found.
  (0) Unavailable: {{function_node __inference_train_function_14623}} failed to connect to all addresses
Additional GRPC error information from remote target /job:localhost/replica:0/task:0/device:CPU:0:
:{"created":"@1599836582.583992584","description":"Failed to pick subchannel","file":"third_party/grpc/src/core/ext/filters/client_channel/client_channel.cc","file_line":3948,"referenced_errors":[{"created":"@1599836582.583991302","description":"failed to connect to all addresses","file":"third_party/grpc/src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":394,"grpc_status":14}]}
	 [[{{node MultiDeviceIteratorGetNextFromShard}}]]
	 [[RemoteCall]]
	 [[IteratorGetNextAsOptional]]
	 [[strided_slice_24/_190]]
  (1) Unavailable: {{function_node __inference_train_function_14623}} failed to connect to all addresses
Additional GRPC error information from remote target /job:localhost/replica:0/task:0/device:CPU:0:
:{"created":"@1599836582.583992584","description":"Failed to pick subchannel","file":"third_party/grpc/src/core/ext/filters/client_channel/client_channel.cc","file_line":3948,"referenced_errors":[{"created":"@1599836582.583991302","description":"failed to connect to all addresses","file":"third_party/grpc/src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":394,"grpc_status":14}]}
	 [[{{node MultiDeviceIteratorGetNextFromShard}}]]
	 [[RemoteCall]]
	 [[IteratorGetNextAsOptional]]
	 [[Cast_1/_62]]
  (2) Unavailable: {{function_node __inference_train_function_14623}} failed to connect to all addresses
Additional GRPC error information from remote target /job:localhost/replica:0/task:0/device:CPU:0:
:{"created":"@1599836582.583992584","description":"Failed to pick subchannel","file":"third_party/grpc/src/core/ext/filters/client_channel/client_channel.cc","file_line":3948,"referenced_errors":[{"created":"@1599836582.583991302","description":"failed to connect to all addresses","file":"third_party/grpc/src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":394,"grpc_status":14}]}
	 [[{{node MultiDeviceIteratorGetNextFromShard}}]]
	 [[RemoteCall]]
	 [[IteratorGetNextAsOptional]]
	 [[Cast_1/_32]]
  (3) Unavailable: {{function_node __inference_train_function_14623}} failed to connect to all addresses
Additional GRPC error information from remote target /job:localhost/replica:0/task:0/device:CPU:0:
:{"created":"@1599836582.583992584","description":"Failed to pick subchannel","file":"third_party/grpc/src/core/ext/filters/client_channel/client_channel.cc","file_line":3948,"referenced_errors":[{"created":"@1599836582.583991302","description":"failed to connect to all addresses","file":"third_party/grpc/src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":394,"grpc_status":14}]}
	 [[{{node MultiDeviceIteratorGetNextFromShard}}]]
	 [[RemoteCall]]
	 [[IteratorGetNextAsOptional]]
	 [[strided_slice_86/_250]]
  (4) Unavailable: {{function_node __inference_train_function_14623}} failed to con ... [truncated]

@RavitejaBadugu
Please, fill issue template from here.
Request you to share colab link or simple standalone code with supporting files to reproduce the issue in our environment. It helps us in localizing the issue faster. Thanks!

dataset::https://www.kaggle.com/c/severstal-steel-defect-detection/data
colab link::https://colab.research.google.com/drive/18fHifO1eXAZREJ8gdkB_XKyD3GlYuolx?usp=sharing

dataset::https://www.kaggle.com/c/severstal-steel-defect-detection/data
colab link::https://colab.research.google.com/drive/18fHifO1eXAZREJ8gdkB_XKyD3GlYuolx?usp=sharing

@ravikyram did u find the solution?

I have tried in colab with TF version 2.3 and was able to reproduce the issue. Please, find the gist here.Thanks!

@jhseu
did you find whats wrong in my code?

@rxsang  and @jhseu
this is another task which is nlp classification task. I am using TPU's and here also, I am getting the same error.
repositry_link::https://github.com/RavitejaBadugu/question-quality-rating/blob/master/stack-overflow.ipynb

@rxsang and @jhseu
did you guys found solution?

I got the answer. When initializing tpu. I didn't gave the tpu address in tpu.ClusterResolver. Now, I got the answer.So, I'm closing the issue.

Hi RavitejaBadugu,
Data generator (e.g. tf.keras.utils.Sequence) on TPUs is not supported as it uses py_function underlyingly. Is there a way to express your input pipeline using tf.data.Dataset?

When building pipeline by tf.data can we apply pandas operations and calling data from files?

When building pipeline by tf.data can we apply pandas operations and calling data from files?

You can create tf.data pipeline using pandas DataFrame, follow the documentation here for examples.
Also, you can load csv files to tf.data using tf.data.Dataset.list_files(train_filepaths, seed=42)

I was recently experiencing similar issues when working with a custom generator function and batched data on TPUs.
What I'm doing now is to pass the data batches individually to model.fit().
So I'm calling consecutive model.fit() statements with the same model, to train on the separate batches one after the other.
I imagine this probably has some tradeoffs relative to passing the different batches into one model.fit(), but I guess it's one possible workaround.


Question about nested form groups

I have a multistep form (5+ pages), and one big FormGroup/ReactiveForm wrapping all of it.
In one specific step, I have dynamic repeated fields, like "name" and "phone" and I'm using something like this:
'phones': FormArray([
  FormGroup({
    'name': FormControl<String>(value: ''),
    'phone': FormControl<String>(value: ''),
  }),
]),

I don't know if I'm using reactive_forms the correct way here. I'm creating a second FormGroup with "name", "phone" and validators. If this form is valid, I add it to the main form ("phones array). So I'm using the main phones array just to hold the values.
My question is: Is there any better solution in that case? Can I do several nested forms? Any problem with that approach?
Tks!

hI @vicenterusso,
Using nested FormGroup to handle a Wizzard (stepper) is completely fine. I use it in my projects, and that is the main reason I have implemented nested FormGroups.
Adding FormGroups to the FormArray dynamically is also correct. But that depends more on your specific implementation. Maybe you don´t need to create a separate FormGroup and add it to the FormArray, maybe you can just add a new FormGroup directly to the array, and bind it to the UI directly from the FormArray (instead of adding it later if it is valid).

Hi, tks for your answer @joanpablo

Maybe you don´t need to create a separate FormGroup and add it to the FormArray, maybe you can just add a new FormGroup directly to the array, and bind it to the UI directly from the FormArray (instead of adding it later if it is valid).

Yeah I tried that, found few examples on Issues sections... but couldn't make it work. If I have 3 fields I need to validade like a group.
If it's bound to the array, how can I add a new empty group? I don't know if I'm making myself clear 😄


order migrations by filename, optional name to migrations

fix in migration tests ...

@ostinelli let it go! don't hold it back anymore

I'd love to, but I've lost track. There are 3 different issues that address the same thing.
Is this it?

@ostinelli I know, @istr did a mess in #10 and missed tests at #18, plus mine can run an specific migration

both leite's and my PR work for me... 😀

thank @istr, i did not want to be mean.
doing good with your fork, looking forward for your features :D

Thank you both. Will merge soon.

merged c17c45190c7805dd59b209593c985c5d203e60ab.


Couldn't find preset "./.babelrc.js" relative to directory "/node_modules/react-virtualized"

I get the following error while trying to compile with the latest version (9.19.0).
Module build failed: Error: Couldn't find preset "./.babelrc.js" relative to directory "/unisport/storefront/node_modules/react-virtualized"
    at /unisport/storefront/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
    at Array.map (<anonymous>)
    at OptionManager.resolvePresets (/unisport/storefront/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
    at OptionManager.mergePresets (/unisport/storefront/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
    at OptionManager.mergeOptions (/unisport/storefront/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
    at OptionManager.init (/unisport/storefront/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
    at File.initOptions (/unisport/storefront/node_modules/babel-core/lib/transformation/file/index.js:212:65)
    at new File (/unisport/storefront/node_modules/babel-core/lib/transformation/file/index.js:135:24)
    at Pipeline.transform (/unisport/storefront/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
    at transpile (/unisport/storefront/node_modules/babel-loader/lib/index.js:50:20)
    at Object.module.exports (/unisport/storefront/node_modules/babel-loader/lib/index.js:173:20)
 @ ./node_modules/react-virtualized-select/dist/commonjs/VirtualizedSelect/VirtualizedSelect.js 41:17-69
 @ ./node_modules/react-virtualized-select/dist/commonjs/VirtualizedSelect/index.js
 @ ./node_modules/react-virtualized-select/dist/commonjs/index.js

@razius
{
  test: /\.js$/,
  exclude: /node_modules/, // add this line
  loader: 'babel-loader'
}

@TrySound , thank you. I didn't know about this.
Feel silly now :)

@GlebDolzhikov same answer. Do not transpile node_modules

@TrySound I had the same issue, adding that line resolved the issue. Thanks for posting 👍

But as i understand it's a part of webpack config? My test environment doesn't use webpack, i try to add transformIgnorePatterns to jest.config - in vain

Just skip this option.
testPathIgnorePatterns [array]
Default: ["/node_modules/"]

Will try when I have some spare time;)

same error.
and i set include src only.
ref: https://github.com/bvaughn/react-virtualized/issues/1112#issuecomment-389755939

@geminiyellow Show config

Faced with the same error. The proposed solution for excluding node_modules folder is not working for me - we have several dependencies that are not being transpiled for non-es6 usage.
So I ended up having the configuration like this:
{
  test: /\.js$/,
  exclude: [
    /node_modules[\\/]react-virtualized/,
  ],
  loader: 'babel-loader',
}

getting the same error as above:
Error: Couldn't find preset "./.babelrc.js" relative to directory "/Users/myFolder/ui/build/vneraapp/js/vendor/react-virtualized"
    at /Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
    at Array.map (<anonymous>)
    at OptionManager.resolvePresets (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
    at OptionManager.mergePresets (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
    at OptionManager.mergeOptions (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
    at OptionManager.init (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
    at File.initOptions (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/index.js:212:65)
    at new File (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/file/index.js:135:24)
    at Pipeline.transform (/Users/myFolder/ui/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
    at DestroyableTransform._transform (/Users/myFolder/ui/node_modules/gulp-babel/index.js:36:22)
Emitted 'error' event at:
    at DestroyableTransform.onerror (/Users/myFolder/ui/node_modules/vinyl-fs/node_modules/readable-stream/lib/_stream_readable.js:558:12)
    at DestroyableTransform.emit (events.js:182:13)
    at DestroyableTransform._transform (/Users/myFolder/ui/node_modules/gulp-babel/index.js:54:9)
    at DestroyableTransform.Transform._read (/Users/myFolder/ui/node_modules/through2/node_modules/readable-stream/lib/_stream_transform.js:184:10)
    at DestroyableTransform.Readable.read (/Users/myFolder/ui/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:443:10)
    at flow (/Users/myFolder/ui/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:813:34)
    at DestroyableTransform.<anonymous> (/Users/myFolder/ui/node_modules/through2/node_modules/readable-stream/lib/_stream_readable.js:683:7)
    at DestroyableTransform.emit (events.js:182:13)
    at onwriteDrain (/Users/myFolder/ui/node_modules/vinyl-fs/node_modules/readable-stream/lib/_stream_writable.js:300:12)
    at afterWrite (/Users/myFolder/ui/node_modules/vinyl-fs/node_modules/readable-stream/lib/_stream_writable.js:288:5)

and webpack is setup this way too:
test: /\.jsx?$/,
exclude: /node_modules/,

What's causing this issue?

You can add this option in package.json in root of your project to exclude your libraries like react-virtualized
Example:
    "jest": {         "setupFiles": [             "./config/jest.setup.js"         ],         "transformIgnorePatterns": [             "/!node_modules\\/lodash-es/",             "/!node_modules\\/react-virtualized/"         ]     }

This alternative of jest.mock

Re: https://github.com/bvaughn/react-virtualized/issues/1112#issuecomment-408435446, is it necessary to mock these in every one of my tests which are failing?  Or is there a better way to do this globally?

This seems like a bug to me.
Being as react-virtualized ships an es build, and points to it via its package.json module and jsnext:main keys, it should also ship its babelrc.js file.
I'm not sure what use the es build is with the babel config being broken.
The reason it's particularly broken is because react-virtualized's package.json has this stanza:
  "babel": {
    "presets": [
      "./.babelrc.js"
    ]
  },


Embedded Column handling: fixes for stencil with vertical offset

Prior to this change, a range/slice of a Field was not well-defined. __getitem__/__setitem__ interpreted a slice as a range relative to the origin, which was confusing (as a negative index in a slice didn't mean wrap-around as usual).

Now these kind of ranges are encoded in a Python range instead of slice.
__getitem__/__setitem__ return values relative to the buffer with usual semantics (they take ArrayIndex = slice|int as argument)
fieldgetitem/fieldsetitem return values relative to the origin (they take FieldIndex = range|int as argument)

I don't see why tests are now failing and I cannot reproduce.

Ah, only partially merged the functional branch...

There are some problems that need a closer look with Col of tuple vs tuple of Col that need a closer look .

Scan constructs Column of tuple, which seems reasonable.
in some other places tuple of Column feels more natural, however can be transformed to col of tuple
in a partially beautified iterator there are some problems: we don't have hooks into the tuple constructor, therefore intermediate results (that are not created via make_tuple) might be tuple of col. They can be transformed if they are in the interface of a fundef, however within a single function, they remain tuple of column, which might result in weird behavior.

The change in the last commit is to make ConstantFields work which don't have the column_axis. There was a test added recently that triggered this.


Script/slides: Sawtooth Development

Generate a script and slides educating students on Sawtooth application development. Should more or less follow this structure:

Birds eye view

What is it?
What is it good for?
Permissioned blockchains

Running components with Docker
The Transaction Processor Model

State, Addresses, and the Merkle Tree
Payload/State Encoding

JSON (sorted, determinism!) and Buffers

Validation

InvalidTransaction error

Clients

Transaction and Batches

Structure
Generating private/public keys
Signing

The REST API

Submitting batches
Fetching state data

Decoding addresses and state

This was done sometime ago:

Slides
Videos


Update Users_Deprovision.ps1

Addition of a test mode to check script function before finally committing to removing the users

@johnjamesmarsh thanks for your contribution!
I'm closing this PR as we added support for DryRun mode in User_Deprovision.ps1 script here https://github.com/box/boxcli/pull/392


Move jest to root directory

Moves jest and configuration to project root for all packages
Updates to Babel 7
Fixes an issue with storybook setup and styled-components

Codecov Report

:exclamation: No coverage uploaded for pull request base (next@61f55c5). Click here to learn what that means.
The diff coverage is n/a.

@@          Coverage Diff          @@
##             next   #381   +/-   ##
=====================================
  Coverage        ?   100%
=====================================
  Files           ?     42
  Lines           ?    418
  Branches        ?      0
=====================================
  Hits            ?    418
  Misses          ?      0
  Partials        ?      0

Impacted Files
Coverage Δ

test-setup.js
100% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 61f55c5...cc8062c. Read the comment docs.


Label printing unit test

This PR increases the coverage for the internal (python) and external (web) label APIs.
Closes #3037

@SchrodingersGat 👀

Nice. Is this intended to replace https://github.com/inventree/InvenTree/pull/3037?

Nice. Is this intended to replace #3037?

Working on it

Ref: https://github.com/inventree/InvenTree/issues/2992

@matmair looks good, almost 1% increase in code coverage! Nice work :)


expvar: Func does not implement Var

What version of Go are you using (go version)?
Go playground, at version go1.15.5.
Does this issue reproduce with the latest release?
Yes, this is present in go1.15.3, and in the playground at go1.15.5.
What operating system and processor architecture are you using (go env)?
Go playground, but first seen on linux/amd64.
What did you do?
Used expvar.Publish with expvar.Func, with a function that returns a struct which encoding/json cannot serialize.
https://play.golang.org/p/9wpvZMJtDmw
package main

import (
	"bytes"
	"encoding/json"
	"expvar"
	"log"
	"net/http"
	"net/http/httptest"
)

func main() {
	try := func() {
		r, err := http.NewRequest("GET", "/debug/vars", nil)
		if err != nil {
			log.Fatal(err)
		}
		w := &httptest.ResponseRecorder{Body: new(bytes.Buffer)}
		expvar.Handler().ServeHTTP(w, r)

		err = json.Unmarshal(w.Body.Bytes(), new(interface{}))
		if err != nil {
			log.Fatalf("Invalid JSON: %v\n%s\n", err, w.Body)
		}
		log.Printf("Valid JSON")
	}

	try()

	log.Printf("Publishing new value")
	expvar.Publish("config", expvar.Func(func() interface{} {
		return struct {
			Fn func()
		}{}
	}))

	try()
}

What did you expect to see?
I expected expvar.Func to implement expvar.Var, meaning it would always return valid JSON. I expected that an HTTP request to /debug/vars would return a valid JSON object. I expected that expvar.Func would recover from an error by returning a boring but valid value, such as null.
What did you see instead?
The String method of expvar.Func ignores the error return value from encoding/json.Marshal, so will return an empty string when the func returns a value that cannot be serialized to JSON.
https://github.com/golang/go/blob/go1.15.5/src/expvar/expvar.go#L261-L264
2009/11/10 23:00:00 Valid JSON
2009/11/10 23:00:00 Publishing new value
2009/11/10 23:00:00 Invalid JSON: invalid character ',' looking for beginning of value
{
"cmdline": ["/tmpfs/play"],
"config": ,
"memstats": {"Alloc":296512,"TotalAlloc":296512,"Sys":71650312,"Lookups":0,"Mallocs":1604,"Frees":320,"HeapAlloc":296512,"HeapSys":66781184,"HeapIdle":66035712,"HeapInuse":745472,"HeapReleased":66002944,"HeapObjects":1284,"StackInuse":327680,"StackSys":327680,"MSpanInuse":19040,"MSpanSys":32768,"MCacheInuse":13888,"MCacheSys":16384,"BuckHashSys":3806,"GCSys":3826440,"OtherSys":662050,"NextGC":4473924,"LastGC":0,"PauseTotalNs":0,"PauseNs":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"PauseEnd":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"NumGC":0,"NumForcedGC":0,"GCCPUFraction":0,"EnableGC":true,"DebugGC":false,"BySize":[{"Size":0,"Mallocs":0,"Frees":0},{"Size":8,"Mallocs":46,"Frees":0},{"Size":16,"Mallocs":676,"Frees":0},{"Size":32,"Mallocs":70,"Frees":0},{"Size":48,"Mallocs":161,"Frees":0},{"Size":64,"Mallocs":34,"Frees":0},{"Size":80,"Mallocs":6,"Frees":0},{"Size":96,"Mallocs":10,"Frees":0},{"Size":112,"Mallocs":4,"Frees":0},{"Size":128,"Mallocs":8,"Frees":0},{"Size":144,"Mallocs":8,"Frees":0},{"Size":160,"Mallocs":16,"Frees":0},{"Size":176,"Mallocs":5,"Frees":0},{"Size":192,"Mallocs":0,"Frees":0},{"Size":208,"Mallocs":35,"Frees":0},{"Size":224,"Mallocs":1,"Frees":0},{"Size":240,"Mallocs":0,"Frees":0},{"Size":256,"Mallocs":13,"Frees":0},{"Size":288,"Mallocs":73,"Frees":0},{"Size":320,"Mallocs":2,"Frees":0},{"Size":352,"Mallocs":10,"Frees":0},{"Size":384,"Mallocs":19,"Frees":0},{"Size":416,"Mallocs":8,"Frees":0},{"Size":448,"Mallocs":0,"Frees":0},{"Size":480,"Mallocs":1,"Frees":0},{"Size":512,"Mallocs":3,"Frees":0},{"Size":576,"Mallocs":5,"Frees":0},{"Size":640,"Mallocs":4,"Frees":0},{"Size":704,"Mallocs":2,"Frees":0},{"Size":768,"Mallocs":0,"Frees":0},{"Size":896,"Mallocs":7,"Frees":0},{"Size":1024,"Mallocs":12,"Frees":0},{"Size":1152,"Mallocs":5,"Frees":0},{"Size":1280,"Mallocs":3,"Frees":0},{"Size":1408,"Mallocs":1,"Frees":0},{"Size":1536,"Mallocs":0,"Frees":0},{"Size":1792,"Mallocs":5,"Frees":0},{"Size":2048,"Mallocs":2,"Frees":0},{"Size":2304,"Mallocs":4,"Frees":0},{"Size":2688,"Mallocs":3,"Frees":0},{"Size":3072,"Mallocs":0,"Frees":0},{"Size":3200,"Mallocs":0,"Frees":0},{"Size":3456,"Mallocs":0,"Frees":0},{"Size":4096,"Mallocs":8,"Frees":0},{"Size":4864,"Mallocs":2,"Frees":0},{"Size":5376,"Mallocs":1,"Frees":0},{"Size":6144,"Mallocs":2,"Frees":0},{"Size":6528,"Mallocs":0,"Frees":0},{"Size":6784,"Mallocs":0,"Frees":0},{"Size":6912,"Mallocs":0,"Frees":0},{"Size":8192,"Mallocs":1,"Frees":0},{"Size":9472,"Mallocs":0,"Frees":0},{"Size":9728,"Mallocs":0,"Frees":0},{"Size":10240,"Mallocs":8,"Frees":0},{"Size":10880,"Mallocs":0,"Frees":0},{"Size":12288,"Mallocs":0,"Frees":0},{"Size":13568,"Mallocs":0,"Frees":0},{"Size":14336,"Mallocs":0,"Frees":0},{"Size":16384,"Mallocs":0,"Frees":0},{"Size":18432,"Mallocs":0,"Frees":0},{"Size":19072,"Mallocs":0,"Frees":0}]}
}

/cc @bradfitz


feat: add hidden skip-to-content button

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Closes #47523
Working:

This will require an id of #content-start on the first heading/ result of the news page too (search results). I was asked to mention this here, for more info - https://discord.com/channels/692816967895220344/715074489422970962/1022137562271330314

there's no need to create multiple ids to jump to

@ojeytonwilliams I'm going to disagree a little here. For the Steps, the skip link should focus on the h1 in the instructions. If it focuses on the #content-start div that wraps main instead, then the user will still have to tab through the bread crumb links and editor/console/preview buttons.
My suggestion is to add an id to the h1 and have the skip link jump to that.

Thanks @bbsmooth, good catch! I agree that it should skip all the navigation, not some of it.  However, the root of the problem is that the navigation components are scattered across the site.
To keep things DRY and reasonably easy to understand, I think it would be better to pull the BreadCrumbs up to the default-layout rather than pushing the target ids down into 8 components.  This may require a bit of Gatsby magic, but it should be doable.

I don't think moving ActionRow from DesktopLayout to DefaultLayout will be that straightforward because of all the props that it requires, I even tried doing so.
Could you point me in the right direction explaining how I can pull the ActionRow component out of DesktopLayout component?

Sure. The Gatsby docs are pretty good, but the main thing you need to do is make the data available inside layout-selector.tsx.  That can be achieved via a GraphQL query which Gatsby will run and then inject the result as a data prop.
So, I'd use the approach in client/src/templates/Challenges/classic/show.tsx as a guide.
Finally, there's no need to move the entire ActionRow, just the BreadCrumb part.  Reason being, the goal is to put all the navigation elements in the DefaultLayout, but the BreadCrumb is the only part of ActionRow that deals with navigation.
I hope that helps!

there's no need to move the entire ActionRow

I personally think that the skip to content link should skip both the bread crumbs and the buttons in the ActionRow, but there is no hard rule on where it should skip to. If we do feel the buttons are part of the main content and shouldn't be skipped then I suggest we might change the text on the skip link to "Skip navigation" which I think would more accurately reflect what the link is doing here.

I elevated the main breadcrumb navigation, it's now a part of the default layout component.

@diivi this is looking great, really nice work.  The only issue I'm running into is that if I tab backwards after skipping past the breadcrumbs, the breadcrumbs receive focus as expected, but they don't scroll into view.  Other pages like /learn, don't have this problem - the page scrolls as I tab around.
Having said all that, this is already present on main, so we've not made things worse.  As such, I'm happy to merge this is if @bbsmooth is and we can deal with the lack of scrolling another time.

@ahmadabdolsaheb as discussed in Discord, these code changes result in duplicate breadcrumbs on all but the new project-based curriculum.  Like so:

and

Would it be okay if simply deleted the smaller ones? That way it's a consistent experience across all our challenge pages.

Waiting for @ahmadabdolsaheb to comment on this to continue.

Yes, the smaller breadcrumb can go.

@diivi I am wondering, is the skip navigation changes related to breadcrumb changes?
Because it's hard to distinguished "why the test are failing", if it's possible to create two PRs, so reviewing and fixing can be easier that would be awesome 👍 . Saying that, maybe I am wrong and breadcrumb is necessary, after all I only skimmed through breadcrumbs discussion
here is what I found reading cypress errors

the new breadcrumbs are stacking on top of textarea
the new elements have changed how the old elements structured (html structure), if people are okay with the new hierarchy, running npm run test -- -u or npx jest -u should create a new snapshot

I have no idea why localization test fails 🤷, I just hope fixing the other two will clear it as well.

I was asked to make the breadcrumbs part of the navigation and not the main content. So I moved them. But then I noticed, on some pages, there were two breadcrumbs, so I removed the second ones with this change. This makes skip to content skip the breadcrumbs too, which shouldn't be a part of the main content but only the navigation bar/header. This is why the two changes are part of the same PR, because if I just add skip to content, it will skip to the breadcrumbs. Should I revert to the point where I just added the skip to content button and skip the breadcrumb navigation in another PR?

No, IMHO the removal of the old breadcrumbs is within the scope of this PR and should stay.

@diivi thank you for more context, it looks like related to skip to the button, so please keep it one PR. sorry for the confusion 👍
Please run one of the snapshot generating command, and fix the first issue however you see fit.
Although I have already seen you in discord and there is no need to link this again, but here it's anyway
If you need help, please join us in our chat room or the forum.

This works really well. LGTM :+1:

Thank you for the awesome work


Linux

Hi there,
I'd like to ask if there is any plan on making this tool available under Linux. I'd be interested in participating.
I'm already running EDMarketConnector under Linux, so I'd be most interested in getting EDScout also running under Linux. Btw, I believe headless mode would be enough.
Thanks

Its open source and python based so every chance we could get it running under Linux with a bit of effort. I don't have a Linux machine with ED on it right now so could be tricky to test initially...

Very well. I guess I'll give it a try.
I've never done any serious programming in python, but I'm willing to try "porting" this tool to Linux.
I'll let you know of any progress.
Best regards

Happy to accept pull requests & offer advice / answer questions along the way 👌🏻

First step (so I could give this a try); How do you run Elite under Linux and what distro are you on?

Try checking out the code and running the commands in https://github.com/joncage/ed-scout/blob/master/Installer/PackageIt.bat
I'll see what I can do on my end.

Hi Jon,
I'd already sent you a few messages on FB, but then, decided to reach you here, and it worked ;)
I'm running Manjaro Linux, and Steam runs great. There's a compatibility layer called Proton that, in conjunction with Wine, allows to play windows games under Linux.
About the path: In windows it's probably hardcoded, if you have default configurations. But in Steam, if you don't stick to default settings, you can define game libraries, each on different paths. It would be nice to be able tell the app where the game is installed.
About the app, I understand it requires Chrome, but EDMarketConnector doesn't...

I've already cloned the project, but haven't looked at the code, yet.
I'll have a look at it, later today ;)

Sounds good.
The chrome requirement is from PyFlaskWebGui which is what I used to turn it into a desktop app so if you want to run headless only you can then fire up whichever browser you like. My intention was just to make a desktop app for Windows (which is what I primarily use) and this was the path of least resistance ;-)
Yeah, I'm sure there's more we can do to make the paths less windows-centric. Could probably break that aspect out into a new module and have it handle windows vs linux pathing nice and tidily.

Hey Jon,
Is there any particular version of python I should use?
Ran:
cd EDScoutWebUI
pyenv install 3.7.8
My pyenv command doesn't have a  instruction so I tried
pipenv run ./EDScout.py -no_app
and got this:
`pipenv run ./EDScout.py -no_app
Traceback (most recent call last):
File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 1635, in system_which
assert c.return_code == 0
AssertionError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/pipenv", line 33, in
sys.exit(load_entry_point('pipenv==2020.8.13', 'console_scripts', 'pipenv')())
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 829, in call
return self.main(*args, **kwargs)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/decorators.py", line 73, in new_func
return ctx.invoke(f, obj, *args, **kwargs)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python3.8/site-packages/pipenv/cli/command.py", line 448, in run
do_run(
File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 2547, in do_run
run_fn(*run_args, **run_kwargs)
File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 2474, in do_run_posix
command_path = system_which(script.command)
File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 1637, in system_which
result = fallback_which(command, allow_global=True)
File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 1583, in fallback_which
result = find_python(finder, command)
File "/usr/lib/python3.8/site-packages/pipenv/utils.py", line 2196, in find_python
result = finder.find_python_version(line)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/pythonfinder/pythonfinder.py", line 262, in find_python_version
version_dict = self.parse_major(major, minor=minor, patch=patch, arch=arch)
File "/usr/lib/python3.8/site-packages/pipenv/vendor/pythonfinder/pythonfinder.py", line 209, in parse_major
int(version_dict["major"]) if version_dict.get("major") is not None else major
ValueError: invalid literal for int() with base 10: './EDScout.py'
`

Yes, sorry you're right that it should be pioenv not pyenv!
cd EDScoutWebUI
pyenv install
pyenv run EDScout.py -no_app

It was tested with python 3.7 and that first install command is important so that python 3.7 (and all the other packages in the pioenv file are collected. I'll double check those commands when I'm back at my machine later. Not had a chance to double check them myself.since writing them..

Here's how it went:
pipenv check
Creating a virtualenv for this project…
Pipfile: /home/jcb/Documents/Elite/ed-scout/Pipfile
Using /home/jcb/.pyenv/versions/3.7.0/bin/python3.7m (3.7.0) to create virtualenv…
⠸ Creating virtual environment...created virtual environment CPython3.7.0.final.0-64 in 187ms
  creator CPython3Posix(dest=/home/jcb/.local/share/virtualenvs/ed-scout-9DnsEjDY, clear=False, global=False)
  seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, via=copy, app_data_dir=/home/jcb/.local/share/virtualenv/seed-app-data/v1.0.1)
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator

✔ Successfully created virtual environment!
Virtualenv location: /home/jcb/.local/share/virtualenvs/ed-scout-9DnsEjDY
Checking PEP 508 requirements…
Passed!
Checking installed package safety…
All good!
[jcb@nightcrawler ed-scout]$ pipenv run python -m EDScoutWebUI.EDScout -no_app
Traceback (most recent call last):
  File "/home/jcb/.pyenv/versions/3.7.0/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/jcb/.pyenv/versions/3.7.0/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/jcb/Documents/Elite/ed-scout/EDScoutWebUI/EDScout.py", line 7, in <module>
    import psutil
ModuleNotFoundError: No module named 'psutil'

This was due do error in 'pipenv install':
nstalling dependencies from Pipfile.lock (418b62)…
 Will try again.
  🐍   ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 47/47 — 00:00:11
Installing initially failed dependencies…
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/cli/command.py", line 232, in install
[InstallError]:       retcode = do_install(
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 2052, in do_install
[InstallError]:       do_init(
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 1305, in do_init
[InstallError]:       do_install_dependencies(
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 899, in do_install_dependencies
[InstallError]:       batch_install(
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 796, in batch_install
[InstallError]:       _cleanup_procs(procs, failed_deps_queue, retry=retry)
[InstallError]:   File "/usr/lib/python3.8/site-packages/pipenv/core.py", line 703, in _cleanup_procs
[InstallError]:       raise exceptions.InstallError(c.dep.name, extra=err_lines)
[pipenv.exceptions.InstallError]: ERROR: Could not find a version that satisfies the requirement pywin32==228 (from -r /tmp/pipenv-jdggc5yb-requirements/pipenv-qtftx53m-requirement.txt (line 1)) (from versions: none)
[pipenv.exceptions.InstallError]: ERROR: No matching distribution found for pywin32==228 (from -r /tmp/pipenv-jdggc5yb-requirements/pipenv-qtftx53m-requirement.txt (line 1))
ERROR: Couldn't install package: pywin32
 Package installation failed...
  ☤  ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 0/1 — 00:00:00

Of course, pywin32 isn't meant for Linux... I'd hoped it could be platform independent...

I think it still can be. Just needs a little work. I'll take another look and see what we can do - watch this space :-)

A quick check suggests it's just the window toggling code that needs pywin32

;)
In the meanwhile, I'm trying to run it under wine.

Try this branch if you're able: https://github.com/joncage/ed-scout/tree/0100-LinuxSupport - I've tried to detect the platform and drop the win32 requirements (although window toggling won't work; I'll need to find some alternatives to do that on Linux but that can wait).

Hello. Out of curiosity I tried this branch and it fails in EDScoutCore/SavedGamesLocator.py because of the import of winreg. That being said, after commenting the import and editing save_game_root so it points to my Steam install, it passes this step. Then it starts but it does not appear do to anything out of the box:
2020-10-09T00:48:41.078Z - EDScoutWebUI-EDScout - INFO - ED Scout Beta Starting
2020-10-09T00:48:41.078Z - EDScoutWebUI-EDScout - DEBUG - Current process: 66537
2020-10-09T00:48:41.098Z - EDScoutWebUI-EDScout - INFO - Disabling caching
2020-10-09T00:48:41.105Z - EDScoutWebUI-EDScout - INFO - No HUD overrides file detected (/home/mederic/AppData\Local\Frontier Developments\Elite Dangerous\Options\Graphics\GraphicsConfigurationOverride.xml)
2020-10-09T00:48:41.106Z - EDScoutCore-FileSystemUpdatePrompter - DEBUG - File size check: 23862

Note that the path to GraphicsConfigurationOverride.xml incrorrect but the fix should be similar as fixing the path to Saved Games.
Now if I connect directly to localhost:5000 it does comes to life and seems to be at least partly working:

Some information seems to be missing compared to https://github.com/joncage/ed-scout/blob/0100-LinuxSupport/Images/UIExplained.png but I am uncertain whether this is another bug or a Linux-specific issue.

Well done indeed - looks like that's working to me. The extra info shows up when you use the FSS to scan for celestial bodies. As you scan, you should see more information appearing near the top.
Thanks for giving this a shot. Next step would be to work out how we can auto-detevt locations on Linux to is works out of the box 👌🏻

Hi there,
I've managed to get this working also...
Like Médéric, had to change a few things:

in file EDScoutWebUI/EDScout.py, commented lines 21 and 222;
in file EDScoutCore/SavedGamesLocator.py,  changed variable save_game_root so it points to my Steam install folder

Here, an example of a route with three discovered and four undiscovered systems:

Thank you so much for your time and effort.
Please let me know if you need any help. I'll be glad to.

I've just cloned the main repo and branch 0100 before it was merged and I'm getting the following error on run
Traceback (most recent call last):
  File "/home/pascal/.pyenv/versions/3.7.9/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/pascal/.pyenv/versions/3.7.9/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/pascal/Repositories/ed-scout/EDScoutWebUI/EDScout.py", line 28, in <module>
    from EDScoutWebUI.VersionChecker import check_version
  File "/home/pascal/Repositories/ed-scout/EDScoutWebUI/VersionChecker.py", line 6, in <module>
    from EDScoutWebUI import version
ImportError: cannot import name 'version' from 'EDScoutWebUI' (/home/pascal/Repositories/ed-scout/EDScoutWebUI/__init__.py)

I had the same problem as @pascaldulieu , but I'm using the latest version (not release) on the main branch, after fiddling around and making a mock 'version' akin to what was already in EDScout.py as well as hardcoding my journal path in SavedGamesLocator.py, it seemingly started working, although the UI shows UNKNOWN star system and no data, possibly due to the bad requests listed in the produced log - I'm guessing my version hack failed horribly

I had the same problem as @pascaldulieu , but I'm using the latest version (not release) on the main branch, after fiddling around and making a mock 'version' akin to what was already in EDScout.py as well as hardcoding my journal path in SavedGamesLocator.py, it seemingly started working, although the UI shows UNKNOWN star system and no data, possibly due to the bad requests listed in the produced log - I'm guessing my version hack failed horribly

I was able to get EDScout 1.7.1 to run natively on Linux after a few hacks:

comment out windows includes until those errors went away
create 'EDScoutWebUI/version.py' containing two lines: release = "v1.7.1" and version = "v1.7.1"
modify 'SavedGamesLocator.py' to point right place (Epic Games + Wine in my case)
update 'EDScoutWebUI/templates.html' to use newer version of socket.io.js (e.g. 3.1.1)
(otherwise you get "client is using an unsupported version of the Socket.IO" errors that @BinaryEnigma01 had)


[Feature] Could please share the basic architecture?

Is your feature request related to a problem? Please describe.
Could please share the basic architecture, like how each component are created and dependent  on each others.
Describe the solution you'd like
Refer: https://github.com/zalando/postgres-operator/blob/master/docs/diagrams/neutral_operator_dark.png#gh-dark-mode-only
Describe alternatives you've considered

Environment details:

Kubernetes version: 1.22
Kubernetes distribution:  Rancher
mariadb-operator version: [Version number]
Install method: helm
Install flavor: [minimal, recommended, or custom]

Additional context

Hey @PGPAWAN ! Thanks for bringing this up.
100%, with the in introduction of MaxScale in v0.0.25 our architecture got a bit more complicated. Not only it may be worth documenting the architecture but the whole MariaDB CR as we did this release with MaxScale.
Something to look into in the next releases.

@mmontes11  Thanks for acknowledging this request, could pls share the  how I can setup the mariaDB operator manually similarly to [https://github.com/zalando/postgres-operator/blob/master/docs/quickstart.md#manual-deployment-setup-on-kubernetes]


MOM review

update

Staging links:
https://longforwisdom.gitbook.io/new-collection/parameter-index/collateral-auction/param-auction-price-function
https://longforwisdom.gitbook.io/new-collection/parameter-index/collateral-auction/param-auction-price-multiplier


Update robotest upgrade targets.

Description
This patch drops validation of 6.1 to 7.1.0-alpha upgrades.
These are replaced with validation from 7.0. Furthermore 6.2 and 6.3
are included per our <=2 minor kubernetes version skew policy and some
recent discussion with @knisbet about whether we support non-LTS to
non-LTS upgrades.
Type of change

Internal change (not necessarily a bug fix or a new feature)

TODOs

[x] Self-review the change
[x] Perform testing
[ ] Address review feedback

Testing done
The PR build is sufficient testing.

The only thing we may want to consider, as an exception to the underlying model, is 6.2 has been out of support for more than 6 months at this point, and 6.3 hasn't had much adoption, with enterprise customers going to 7.0, so it might be safe to try and save a few CPU cycles, dropping 6.2 and maybe 6.3 for the time being.

I yanked 6.2 and 6.3 from PR builds in 5269615, but I left them in nightly builds.  This is probably an appropriate level of testing for "technically supported but unlikely to ever be used"


Overview issue: Leaderboard 2.0 release

[ ] https://github.com/embeddings-benchmark/mteb/issues/1404
[ ] https://github.com/embeddings-benchmark/mteb/issues/1396
[ ] Ensure old results are present in the new leaderboard
[ ] Review of a public demo of the leaderboard
[ ] merge https://github.com/embeddings-benchmark/results/pull/40
[ ] https://github.com/embeddings-benchmark/mteb/issues/1373
[ ] https://github.com/embeddings-benchmark/mteb/issues/1317
[ ] Anything else that I am missing?

Once everything is ready I will push the preprint of the paper and we can make a coordinated public release.

Added #1317 and #1373 as well. Feel free to remove / reclassify them if they are nice-to-haves instead of need-to-haves.

We now have a demo of the new leaderboard. Feel free to either open new issues as they come along or conduct discussions in this thread

new leaderboard seems to be down.

I believe it's due to an issue in Arctic models' metadata, I'll have a look

I have found the source of the problem, working on a fix rn.

Fixed

@gaohongkui note sure what you mean?

@gaohongkui note sure what you mean?

I mean, if the metric of task_type can be switched at a certain position on the page,
and then the leaderboard is sorted according to the new metric (for example, using recall@10 or ndcg@10 for Retrieval may result in different sorting results).
This is convenient for observing the model effect from more angles.
This might be considered a feature request. Should I discuss it here or open a separate issue?

Ahh gotcha, feel free to open a seperate issue on this. Probably won't be in the first release of the leaderboard though

Overview of what is missing
We opened the following issues during review:

[ ] https://github.com/embeddings-benchmark/mteb/issues/1411
[ ] https://github.com/embeddings-benchmark/mteb/issues/1509
[ ] https://github.com/embeddings-benchmark/mteb/issues/1571
[ ] https://github.com/embeddings-benchmark/mteb/issues/1514
[ ] https://github.com/embeddings-benchmark/mteb/issues/1516
[ ] https://github.com/embeddings-benchmark/mteb/issues/1550
[ ] https://github.com/embeddings-benchmark/mteb/issues/1556
[ ] https://github.com/embeddings-benchmark/mteb/issues/1605

Nice to have, but not need to have:

[ ] https://github.com/embeddings-benchmark/mteb/issues/1013
[ ] https://github.com/embeddings-benchmark/mteb/issues/1622
[ ] https://github.com/embeddings-benchmark/mteb/issues/1517


Use msiexec to install Cosmos emulator.

This PR experimentally uses the same approach to installing the Cosmos emulator as is used in the Python repo. Doing this because it appears to be unreliable using PowerShell to download from the CDN hosting the MSI binary, and the msiexec invocation copes with it better.

/azp run java - cosmos

/azp run java - cosmos

/azp run java - cosmos

/azp run java - cosmos


Unable to enter "__c" suffix for Custom Object name in Custom Metadata

I'd like to use the dynamic flow component on a custom object, and am prompted to enter the full API name of that object when I open the component in the UI. However, receive the following message when attempting to do so, and am unable to enter "__c" in a custom metadata record:
Errors:
• Custom Metadata Record Name: The Dynamic Flow Component API Name can only contain underscores and alphanumeric characters. It must be unique, begin with a letter, not include spaces, not end with an underscore, and not contain two consecutive underscores.
• The Custom Metadata Record Name field can only contain underscores and alphanumeric characters. It must be unique, begin with a letter, not include spaces, not end with an underscore, and not contain two consecutive underscores.


Remove instances with [ or ] from etcc.txt

etcc.txt that used to created a dictionary for Enhanced Thai Character Cluster tokenization has [ and ] characters, where it shouldn't.
Removed all of them.

Coverage remained the same at 95.01% when pulling 908a80063c4fa3f75f125d6178fc1b4b798fbd2e on fix-etcc-dict into 27ee24823364dd98e243db26e5fe9a5d1c4ff819 on dev.


NIFI-7638 Added PBE AEAD algorithm for flow sensitive properties

Thank you for submitting a contribution to Apache NiFi.
Please provide a short description of the PR here:
Description of PR
Adds a new algorithm for nifi.sensitive.props.algorithm to support robust encryption of sensitive flow values.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[x] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[x] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[x] Has your PR been rebased against the latest commit within the target branch (typically main)?

[x] Is your initial contribution a single, squashed commit? Additional commits in response to PR reviewer feedback should be made on this branch and pushed to allow change tracking. Do not squash or use --force when pushing to allow for clean monitoring of changes.

For code changes:

[x] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[x] Have you written or updated unit tests to verify your changes?
[ ] Have you verified that the full build is successful on JDK 8?
[x] Have you verified that the full build is successful on JDK 11?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[ ] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[x] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check GitHub Actions CI for build issues and submit an update to your PR as soon as possible.

This PR is ready for review & merge.

+1 LGTM. Able to run a full build, confirmed I receive the exception message when password is too short or not provided.

Thanks all for the reviews. Merging.


Collumn for GPU Memory, GPU CUDA usage from processes

Description of the feature, modification, idea or suggestion
Currently I only found GPU % in general and some shared / dedicated bytes. It would be helpful for me if I could monitor the GPU Memory usage and GPU CUDA usage per app. The regular task manager also has:

"Video encode/decode" (For HVENC I assume)
"3D" (Which I think is Raster or the generic % SystemInformer has)
"CUDA" (Can't see it on my 1070gtx even though it has CUDA cores, but I've seen it elsewhere)

and a few more I don't see use in personally.

Proposed implementation details (optional)
No response

Is there anything that you miss?
As i have built-in Vega, there is no CUDA cores indication. But i don't know what you want to see more?

Post a screenshot of your SI System information + GPU Nodes, so that we can see what information you are missing comparing to TaskManager.

Sorry I should've done more testing and research. About the whole CUDA thing, I went on all my life thinking Nvidias GPU has two different cores, something something 3D raster for games and CUDA for professional work and I was just humbled researching into what CUDA actually is.
What I meant originally though is the ability to sort by GPU Memory on processes. eg:

thinking Nvidias GPU has two different cores, something something 3D raster for games and CUDA for professional work

They do have different cores. These are divided into nodes and are visible from the System Information window -> GPU section -> click the Nodes button.

What I meant originally though is the ability to sort by GPU Memory on processes. eg:

You can already sort by GPU memory? The columns for GPU memory are called GPU dedicated bytes and GPU shared bytes ?

GPU dedicated bytes is memory from the graphics card.
GPU shared bytes is memory from RAM.

They do have different cores. These are divided into nodes and are visible from the System Information window -> GPU section -> click the Nodes button.

Well, not quite from my research.

CUDA is simply Nvidias API that gives developers access to the cores on the GPU. While I have heard the term "CUDA core", in graphics a CUDA core is analogous to a stream processor which is the type of processing core that the graphics cards use. CUDA runs programs on the graphics cores, the programs can be shaders or they can be compute tasks to do highly parallel tasks such as video encoding.
src

Regardless though, I've seen screenshots with CUDA in the default task manager, but I don't have them neither in regular task manager nor sysinformer.

I don't see CUDA here though? Or do I need a quatro card?

Thanks for the extensive details! I'll just rely on the generic 3D node. I did mention uptop that 3D has both CUDA and regular workloads underneath it, now I learned why ^^.


Add note about multiple loggers

VSTest allows to specify the "--logger" multiple times. It seems "dotnet test" allow it too. However the documentation is not clear about it. Maybe it could add the same note as the vstest doc: https://github.com/MicrosoftDocs/visualstudio-docs/pull/5482/files

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 61ca4064-7481-a263-60fc-c70127f2ad16
Version Independent ID: 2878af44-8208-7bd8-46d4-3acda3e82ce0
Content: dotnet test command - .NET CLI
Content Source: docs/core/tools/dotnet-test.md
Product: dotnet-fundamentals
Technology: dotnet-cli
GitHub Login: @tdykstra
Microsoft Alias: tdykstra

Thanks for the suggestion, @meziantou !

Thanks for the suggestion, @meziantou !


pip: fix issues with 3.6 being dropped

Requested in https://github.com/conda-forge/pip-feedstock/pull/88

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Thoughts @conda-forge/core?

@henryiii Can you post the ouput of running recipe/show_diff.py with this PR?

If you merge master into this branch, the show diff script will run in the CI now.

@beckermr I'm failing to find where that is shown. Can you point me to what's changed? The closest I can see is:
https://github.com/conda-forge/conda-forge-repodata-patches-feedstock/blob/16d415321c16aa8f953fd36250819110f9450540/recipe/meta.yaml#L43

Woops! I just merged the PR with it. rebase onto master and you'll get the changes


Add PR creation

Out of discussion: https://github.com/NixOS/nixpkgs/pull/92612#discussion_r451192710
On a power-user workflow (which avoids leaves the command line end-to-end),
it would make sense to combine two things of tow different authoritative origin
in the first PR message:

Origin 1: GithubTemplate per contribution type (new pkg, new module, pkg update, module update)
Origin 2: Preliminary results of local nipkgxs-review session

Supersedes #114 #113
/cc @jtojnar uses gh to avoid leaving the command line, but it's not trivial to combine PR template and local input from ./result.md (correct me if I'm wrong)
ANother argument is automating PR with query parameters, see: https://docs.github.com/en/github/managing-your-work-on-github/about-automation-for-issues-and-pull-requests-with-query-parameters

Does this work for you?
$ hub pull-request -m "$(cat .github/PULL_REQUEST_TEMPLATE.md)" -m "$(nix-review wip)"

Sounds perfect!

I would rather add this feature to nix-update: https://github.com/Mic92/nix-update/
It already supports nixpkgs-review feature.


Implement API calls in Member API v2 needed for trading UI

closed in https://github.com/mnaichuk/peatio/commit/8b3909013150bfc9936e604c2686f135b98d6727


Implement support for wasi-nn

Do you guys plan on adding support for wasi-nn?

So far there were no plans to add wasi-nn capabilities to Wasmi's experimental WASI implementation.
The WASI implementation that exists in Wasmi today was contributed externally and is experimental because it builds on top of Wasmtime's WASI implementation.
The Wasmi project is happily accepting contributions to extend its WASI capabilities. :)


Is there a key vault List Certificates API?

Service Package Request
Hi, I'm using Azure Golang SDK to integrate Azure Key Vault certificates access. Is there any APIs I can use to implement something like ListCertificates() to get details of certificates stored in Key Vault?
From Azure CLI there is a command doing what I want:
az keyvault certificate list
https://docs.microsoft.com/en-us/cli/azure/keyvault/certificate?view=azure-cli-latest#az_keyvault_certificate_list

Hi @shaobovaltix thanks for this issue.
Actually we have this function, could you please have a look if this could meet your requirement?


Add list of acceptable types when hovering over node input

As noted by Lerc, it would be helpful for the NodeInput tooltip to display all acceptable types that will not cause a node error. For protonodes, this would require accessing the list of implementations, which are defined in the node macro. The implementations would then be filtered based on the current type of all other inputs to return a list of all currently valid types for that input. Network nodes are a bit more complex, since the inputs will undergo automatic type casting (2042), and all usages need to be valid. This means the acceptable types will be the intersection of all types that implement From for the network input type, and all types that the import is connected to.

maybe this solution will solve your problem click

Hey @adamgerhant Could I take this issue?

Sure! Dont worry about the automatic type casting yet. I would focus on just getting the proto node hovering tooltips to work, then work on the network nodes.

Hey @adamgerhant should it look something like this:

Yes

i have implemented for protonodes please have a look in your free time and regarding network nodes I wanted to know like if i have created this node shouldn't this part automatically assign the input of that network node to be for example in this Number
as the first node is divide similar to the output of the node or am i missing something:

No, that is currently the correct display. This node would give a type error when being executed since an input of TaggedValue::None is being supplied to the encapsulating network, which gets fed into the Divide node, which expects a number.

Ok so how should I approach to display the type accepted by the network node in this case

When hovering over input for the encapsulating network node (which is not currently visible since its in the document network), it should use the outward connections from the import (currently visible) and return the supported type of that Divide node input.

Sorry to bother you I had a question that how will i check that the node is a custom network node since it is also a type of Default Network and also how can i access the imports of that since its a nodeGraph.


Active Subscription does not recreate CSV if deleted

Bug Report
What did you do?

Create CatalogSource backed by a configmap with several CSVs in it.
Create a Subscription to one of the channels in the catalog
See the CSV get created along with the operator
After some time, delete the CSV
The Subscription becomes an orphan, no CSV is ever recreated for it

What did you expect to see?
When the Subscription reconciles and there is no CSV in place for it, is should be re created.
What did you see instead? Under which circumstances?
CSV was never recreated.   ONLY if you delete and recreate the Subscription does it come back.
Environment

operator-lifecycle-manager version:

0.14.1

Kubernetes version information:

1.16

Kubernetes cluster kind:

IKS
Possible Solution
Any subscription change, channel update for example, should cause the CSV to be triggered just like delete and recreate the subscription.
Additional context

@ecordell Any thoughts on this one?   Right now we have to workaround with a delete/create of subscription each time the catalog is changed.

Bump

Bump

Bump

This has been bumped, but is it reproducible today? I believe that the new resolver that landed last year would have fixed this.

This has been bumped, but is it reproducible today? I believe that the new resolver that landed last year would have fixed this.

We are using olm 0.16.1. When we delete the CSV neither the InstallPlan nor the Subscription causes the CSV to be regenerated. I deleted the CSV yesterday and today I checked if it was regenerated.
k get csv -A
No resources found.

k get installPlan -A
NAMESPACE       NAME            CSV                     APPROVAL    APPROVED
ibm-operators   install-9gwrn   istio-operator.v1.8.2   Automatic   true

k get pod -n ibm-system
NAME                                READY   STATUS    RESTARTS   AGE
addon-catalog-source-8cxqr          1/1     Running   0          18h
catalog-operator-5755496c77-8pxsj   1/1     Running   0          18h
olm-operator-796f57756c-p487h       1/1     Running   0          18h

k get deploy -n ibm-system -o wide
NAME               READY   UP-TO-DATE   AVAILABLE   AGE   CONTAINERS         IMAGES                                                   SELECTOR
catalog-operator   1/1     1            1           18h   catalog-operator   registry.ng.bluemix.net/armada-master/olm:0.16.1-IKS-5   app=catalog-operator
olm-operator       1/1     1            1           18h   olm-operator       registry.ng.bluemix.net/armada-master/olm:0.16.1-IKS-5   app=olm-operator


Inconsistent Error: 1 Channel not found

We are experiencing random Error: 1 Channel not found errors during terraform apply.
resource "rollbar_notification" "occurrence_rate_prod" {
  rule {
    filters {
      <...>
    }
    trigger = "occurrence_rate"
  }
  channel = "slack"
  config {
    show_message_buttons = true
    channel              = "rollbar-notifications-prod"
  }

  depends_on = [rollbar_integration.slack_integration]
}

After running terraform plan, we have 51 to change terraform resources - all of those are occurrence_rate Slack notifications (due to this issue). When running terraform apply, we receive 10 Error: 1 Channel not found errors (sometimes there are only 2 errors, sometimes >10).
Changing the channel name to #rollbar-notifications-prod (with #) gives us an additional Error: 1 The channel cannot be found error for rollbar_integration resource (Error: 1 Channel not found also occur).
Here are examples of errors:
│ Error: 1 Channel not found
│
│   with module.account_service_notifications.rollbar_notification.occurrence_rate_prod,
│   on modules/rollbar-notifications/notifications_prod.tf line 48, in resource "rollbar_notification" "occurrence_rate_prod":
│   48: resource "rollbar_notification" "occurrence_rate_prod" {

│ Error: 1 The channel cannot be found
│
│   with module.event_streaming_service_notifications.rollbar_integration.slack_integration,
│   on modules/rollbar-notifications/slack_integration.tf line 1, in resource "rollbar_integration" "slack_integration":
│    1: resource "rollbar_integration" "slack_integration" {

@alinazabara Thanks for reporting this issue. We'll investigate what goes wrong and will get back to you when finding something out.
@pawelsz-rb Can you look into this one too? This seems to be connected with https://github.com/rollbar/terraform-provider-rollbar/issues/285

@nieblara Pawel suspects that this is an API-side issue. Can you look into it, please?

Any progress on that? Still have same issue

Hey @BorisDr, This issue should have been fixed by a previous release. Can you confirm the provider version you use?

Still present on provider version v1.12.0 if update many items in a row (more than 100). For example if I have 20 projects (1 project per service) and 11 rules for each project - I need to apply configuration 4-6 times because of Error: 1 Channel not found error.
Probably some kind of API throttling or requests limit


docs: update sdk to 4.12.0

We also need to update https://developers.rune.ai/docs/advanced/using-time-in-your-game, but I'll do that in a separate PR